Try not to create objects when it's not necessary. Why not just check if the player's x, y coordinates are within the camera frustum, if not shift the Scene.
I need the rectangles which are the bounding box for the walls in the map. Without those, I cannot do collision.
Try translating the boxes instead of creating new objects.