Apparently genTextures and friends only "reserves names", initializing them will actually create them. Using glObjectLabel on textures before initializing them will throw a GL_INVALID_VALUE error.