Package: hboard
hboard中文This project provides a web based visualization tool for experiment information. In general, Hypernets writes the experiment events into a text file. This tool could monitor the file and make these events visible.InstallationInstall with pippipinstallhboardInstall with condacondainstall-cconda-forgehboardInstall with source codeCreate a frontend project after installing the front-end libraryhboard-frontend:Create the required software environment：nodejs v14.15.0+Besides, this project requires the package manageryarnand the module bundlerwebpack. Install them by the following command:npm install -g webpack webpack-cli yarnClone the project codes:gitclonehttps://github.com/DataCanvasIO/HyperBoard.gitBuild the project:cdhboard/js# build frontendyarn
yarnbuild
rm-rf../hboard/assets/
cp-rbuild/../hboard/assets/# installcd..
pythonsetup.pyinstallExample of hboardThe folllowing steps shows how to implement the hboard：Create an empty event file to store the experiment statestouchevents.txtCreate a web server to monitor the event filefrom hboard.app import WebApp
webapp = WebApp("events.txt")
webapp.start()The web server outputs logs as：02-2420:45:58Ihboard.app.py77-experimentvisualizationhttpserverisrunningat:http://0.0.0.0:8888The web can be accessed viahttp://localhost:8888。Add detailed experiment events to the file 'event.txt' by command:echo'{"type": "experimentStart", "payload": {"task": "binary", "datasets": [{"kind": "Train", "task": "binary", "shape": [904, 17], "memory": 123072}], "steps": [{"index": 0, "name": "data_clean", "type": "DataCleanStep", "status": "wait", "configuration": {"cv": true, "data_cleaner_args": {"nan_chars": null, "correct_object_dtype": true, "drop_constant_columns": true, "drop_label_nan_rows": true, "drop_idness_columns": true, "drop_columns": null, "reserve_columns": null, "drop_duplicated_columns": false, "reduce_mem_usage": false, "int_convert_to": "float"}, "name": "data_clean", "train_test_split_strategy": null}, "extension": {}, "start_datetime": null, "end_datetime": null}, {"index": 1, "name": "space_searching", "type": "SpaceSearchStep", "status": "wait", "configuration": {"cv": true, "name": "space_searching", "num_folds": 3, "earlyStopping": {"enable": true, "exceptedReward": null, "maxNoImprovedTrials": 10, "timeLimit": 3600, "mode": "max"}}, "extension": {}, "start_datetime": null, "end_datetime": null}, {"index": 2, "name": "final_ensemble", "type": "EnsembleStep", "status": "wait", "configuration": {"ensemble_size": 20, "name": "final_ensemble", "scorer": "make_scorer(accuracy_score)"}, "extension": {}, "start_datetime": null, "end_datetime": null}], "evaluation_metric": null, "confusion_matrix": null, "resource_usage": null, "prediction_stats": null}}'>>events.txtNow the web initialization is finished. The Hypernets experiment writes the events by callback. The web will update the lastest experiment states automatically.Visualization when the experiment is finishedOncehboardinstalled, use the command 'hboard' to visualize the finished experiment.hboard-h
usage:hboard[-h]{server}...

hboardcommandisusedtovisualizetheexperiment

positionalarguments:{server}serverstartwebserver

optionalarguments:-h,--helpshowthishelpmessageandexitSee example below:Clone the codesgitclonehttps://github.com/DataCanvasIO/HyperBoard.gitStart the web server and load the experiment datacdHyperBoard
hboardserver--event-file=hboard/hboard/tests/events_example.jsonView the experiment dashboard viahttp://localhost:8888.Related projectCurrently,HyperGBMhas integrated this tool. The HyperGBM experiment could callback the web visualization function and display the experiment dashboard. Please refer toExperiment Visualization。