A large crowd was on hand to voice their opposition to the tower, citing the obstruction of their view and a decline in property values