The main difference between Province and District is that the Province is a territorial entity within a country or state and District is a type of administrative division, in some countries. A province is almost always an administrative division, within a country or state.

District vs Province - What's the difference? is that district is an administrative division of an area while province is a subdivision of government usually one step below the national level; (canada) one of ten of canada's federated entities, recognized by the constitution and having a separate representative of the sovereign (compare territory).