loaded chunks We retain a list of loaded entities specifically for this usage
Just limit to the same valid location check as BaseBlockPosition, no reason to restrict to the world border. Ref: GH-3165