Mountains count, the height limit starts from wherever you launch from.

Structures count as well, so if you’re flying within 400ft of a 400ft tall building, you can fly up to ~800ft.

Carrying a jar of dirt sadly does not work.

No fly zones and certain classes of airspace (such as near airports, active stadiums) always take priority over this.

These rules are highly location and country/province specific.