Package: provbook
ProvBook: Provenance of the Notebook.ProvBook is an extension of theJupyter Notebook. It provides features to capture and display the provenance of Jupyter Notebook executions, download the notebook in machine-readable format along with the provenance information and compare the input and output of each cell in different runs.ProvBook provides three features:Provenance of Jupyter Notebook:
Tracks and stores the provenance of a Jupyter Notebook execution.Machine-Readability of Jupyter Notebook:
Provides the feature to download the notebooks in a machine-readable format.Diff of Jupyter Notebook Runs:
Compare the results of different executions of a Jupyter Notebook code cell along with the input.DemoA video showing the installation and use of ProvBook with an example is availablehere.PublicationProvBook: Provenance-based Semantic Enrichment of Interactive Notebooks for Reproducibility, Sheeba Samuel and Birgitta König-Ries, The 17th International Semantic Web Conference (ISWC) 2018 Demo TrackA Provenance-based Semantic Approach to Support Understandability, Reproducibility, and Reuse of Scientific ExperimentsInstallationPrerequisite:Jupyter NotebookInstall provbook with pip:pipinstallprovbookAfter the installation, start the Jupyter notebook and you will see the ProvBook icons added in the toolbar as shown below.ProvBookProvenance of Jupyter NotebookThis module tracks the provenance of the Jupyter Notebook. It captures and stores the provenance of the run/execution of the cells over the course of time. Every time the notebook is executed, the provenance of the execution is stored in the metadata of the cell. Every cell is extended with a provenance area with a slider. The provenance area shows the history of the execution of each code cell. The provenance information of the cell execution includes the start and end time of each execution, total number of runs, the total time it took to run the code cell, the source code and the output got during that particular execution. It also shows the provenance of text cells where it displays the modified time and the source.ProvBook icons are added in the toolbar for displaying the provenance of selected or all cells and the provenance difference of executions of cells.ProvBook also adds a provenance menu in the Jupyter Notebook interface.A user can toggle the provenance display for a selected cell from Cell -> Provenance -> Toggle visibility (selected).
A user can clear the provenance data from the metadata of the notebook from Cell -> Provenance -> Clear (all).Machine-Readability of Jupyter NotebookThis module provides the user the feature to download the notebooks in a machine-readable format. It provides the user the ability to convert the notebooks into RDF (Resource Description Framework)along with the provenance traces and execution environment attributes. This helps to semantically represent the provenance information of notebook execution.
This is a command-line utility which takes a notebook as input and generates the RDF Turtle file. The RDF is generated using theREPRODUCE-ME ontologyextended from W3C standard PROV-O and the P-Plan ontology. The RDF generated from the notebook can be converted back to a Jupyter Notebook. The notebook can be downloaded as RDF from the Notebook interface.Example usage of notebook_rdf from command lineConvert your notebook to RDFnotebook_rdfyour_notebook.ipynbornotebook_rdf--fromnotebookyour_notebook.ipynb--toRDFConvert your RDF to notebooknotebook_rdfnotebook_rdf.ttlornotebook_rdf--fromRDFnotebook_rdf.ttl--tonotebookThe notebook can also be downloaded as RDF from the File Menu -> Download as -> RDF (.ttl).Diff of Jupyter Notebook RunsThis module helps users to compare the results of different executions of a Jupyter Notebook. The user is provided with a dropdown to select two executions based on the starting time of the executions. The users can select the original experimenter’s execution with their own execution of the Jupyter Notebook as well.When the user selects the two executions, the difference in the input and the output of these executions are shown side by side.If there are differences in the input or output, the difference is highlighted for the user to distinguish the change.
This module is based on thenbdimefrom the Project Jupyter. It extends the nbdime tool and calls the API from nbdime to see the difference between the provenance of each execution of a notebook code cell.InternalsThe provenance is stored in the metadata of the notebook. Every time a code cell is executed, a new entry 'provenance' is added to the metadata of the code cell. The start and end time of the execution is added with the time it took to execute. The source and the output obtained from executing the cell is added to the metadata so that it can be shared with other collaborators to verify the output. The ProvBookDiff is based on the nbdime provided by Jupyter Notebook Development team.