Package: cdhf
CERN Data Handling FrameworkIntroduction ☕️Dataset DescriptionMattermost is an open-source communication platform similar to slack that is widely used at CERN. The CERN Anonymized Mattermost Dataset includes Mattermost data from January 2018 to November 2021 with 20794 CERN  users, 2367 Mattermost teams, 12773 Mattermost channels, 151 CERN buildings, and 163 CERN  organizational units. The data set states the relationship between Mattermost teams, Mattermost channels, and CERN users, and holds various information such as channel creation, channel deletion times, user channel joining and leave times, and user-specific information such as building and organizational units. To hide identifiable information (e.g. Team Name, User Name, Channel Name, etc.), the dataset was anonymized. The anonymization was done by omitting some attributes, hashing string values, and removing connections between users/teams/channels.Dataset License:CC BY-NC Creative Commons Attribution Non-Commercial LicenceDataset Link: CERN Anonymized Mattermost Data |Zenodo@dataset{jakovljevic_igor_2022_6319684,author={Jakovljevic, Igor andWagner, Andreas andGütl, Christian andPobaschnig, Martin andMönnich, Adrian},title={CERN Anonymized Mattermost Data},month=mar,year=2022,publisher={Zenodo},version=1,doi={10.5281/zenodo.6319684},url={https://doi.org/10.5281/zenodo.6319684}}Getting Started 🏁Setup Repository 💻1. Clone the repository$ git clone https://github.com/mpobaschnig/cdhf2. Retrieving the DatasetRetrieve Mattermost Data (mmdata.json) fromZenodo. To retrieve the dataset execute:$bashcdhf/init.shOr, you can manually create theinput/directory in the root folder, then download themmdata.jsoninto theinputdirectory.3. Jupyter NotebookCreate the jupyter notebook (undefined.ipyb) file in the root level directory.4. ConclusionIn the end it should look like this:.
├── cdhf
│   ├── __init__.py
│   ├── init.sh
│   ├── LICENSE
│   ├── README.md
│   └── src
│       └── mattermost
│           ├── channel_member_history_entry.py
│           ├── channel_member.py
│           ├── channel.py
│           ├── data.py
│           ├── __init__.py
│           ├── team_member.py
│           ├── team.py
│           └── user_data.py
├── input
│   └── mmdata.json
└── undefined.ipynbWorking with the Framework and Jupyter Notebooks 💻Then include this file in the notebook from the root levelfromcdhfimportDataCreate the Data object to work with the data set:data=Data("path/to/Mattermost/JSON/file")data.load_all()print(len(data.teams))Documentation 🖨️API documentation is available athttps://mpobaschnig.github.io/cdhf/.Citation ✍️If you happen to mention or use this project as part of one of your scientific works, please cite the following paper:Jakovljevic, I., Pobaschnig, M., Gütl, C. and Wagner, A., 2022. Privacy Aware Identification of User Clusters in Large Organisations based on Anonymized Mattermost User and Channel Information. In: DATA ANALYTICS 2021, The Tenth International Conference on Data Analytics.@inproceedings{DataAnalytics2022,author={ Jakovljevic, I., Pobaschnig, M., Gütl, C. AND Wagner, A. },year={ 2022 },month={ 11 },title={ Privacy Aware Identification of User Clusters in Large Organisations based on Anonymized Mattermost User and Channel Information }}Latest publications 📚Jakovljevic, I., Gütl, C., Wagner, A. and Nussbaumer, A. Compiling Open Datasets in Context of Large Organizations while Protecting User Privacy and Guaranteeing Plausible Deniability. In Proceedings of the 11th International Conference on Data Science, Technology and Applications (DATA 2022)@article{Data2022,author={ Jakovljevic, I., Gütl, C., Wagner, A. and Nussbaumer, A. },title={ Compiling Open Datasets in Context of Large Organizations while Protecting User Privacy and Guaranteeing Plausible Deniability },journal={ In Proceedings of the 11th International Conference on Data Science, Technology and Applications (DATA 2022) },year={ 2022 }}Involved institutions 🏫Contributors from the following institutions were involved in the development of this project:CERNGraz University of TechnologyVisual Exploration & Analysis 👁️‍🗨️In case you would like to visually explore the CERN Mattermost dataset without any programming you can useCollaboration Spotting X.It is a web-based visual network analytics application which includes various convenient features which enable exploration of network datasets on the fly.To get started with exploring the CERN Mattermost dataset read the instructions of CSX.Acknowledgements 🙏We would like to express our gratitude to CERN, for allowing us to publish the dataset as open data and use it for research purposes.