Some city planning officials said they have concerns about building a project that could include hundreds of apartment units near the center of town.