Open Data Portal Catalogue

The open data portal catalogue is a downloadable dataset containing some key metadata for the general datasets available on the Government of Canada's Open Data portal.

Resource 1 is generated using the [ckanapi tool](https://github.com/ckan/ckanapi/blob/master/README.md#bulk-dumping-and-loading) (*external link*)

Resources 2 - 8 are generated using the [Flatterer](https://flatterer.opendata.coop/) (*external link*) utility.



###Description of resources: 

 1. [Dataset](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/27f49273-d645-4950-9a58-c3086d833d57) is a [JSON Lines](https://jsonlines.org/) (*external link*) file where the metadata of each Dataset/Open Information Record is one line of JSON. The file is compressed with GZip. The file is heavily nested and recommended for users familiar with working with nested JSON.

2. [Catalogue](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/b8931c16-0710-4c31-bbda-f60841e98cb4) is a XLSX workbook where the nested metadata of each Dataset/Open Information Record is flattened into worksheets for each type of metadata. 

3. [datasets metadata](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/312a65c5-d0bc-4445-8a24-95b2690cc62b) contains metadata at the `  dataset`  level. This is also referred to as the `   package `   in some CKAN documentation. This is the `   main `   table/worksheet in the SQLite database and XLSX output.

4. [Resources Metadata](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/3c911562-c541-463f-8cd4-490182cd57f9) contains the metadata for the resources contained within each dataset.

5. [resource views metadata](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/a79f7297-9b20-427a-be79-d286daa92412) contains the metadata for the views applied to each resource, if a resource has a view configured. 

6. [datastore fields metadata](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/3733106d-74f1-428e-beda-cad530b473cf) contains the DataStore information for CSV datasets that have been loaded into the DataStore. This information is displayed in the Data Dictionary for DataStore enabled CSVs.

7. [Data Package Fields](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/09c51a72-e803-4050-8b8f-165809bccf05) contains a description of the fields available in each of the tables within the Catalogue, as well as the count of the number of records each table contains. 

8. [data package entity relation diagram](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/21ad0300-b9f5-444e-b43b-8bd164901b55) Displays the title and format for column, in each table in the Data Package in the form of a ERD Diagram. The [Data Package](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/f13ed9cc-e460-42ca-a526-56e02ecaefaa) resource offers a text based version.

9. [SQLite Database](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/b7f0c11e-e81f-46e7-958d-0bbf878a3df6) is a `   .db `   database, similar in structure to  [Catalogue](https://open.canada.ca/data/en/dataset/c4c5c7f1-bfa6-4ff6-b4a0-c164cb2060f7/resource/b8931c16-0710-4c31-bbda-f60841e98cb4). This can be queried with database or analytical software tools for doing analysis.

 

   

Organization: Treasury Board of Canada Secretariat | Secrétariat du Conseil du Trésor du Canada