Saravanan666/pypi-org huggingface dataset:
Package: crawlerdetect-coreteam
About CrawlerDetectCrawlerDetectis a Python version of PHP class @CrawlerDetect.It helps to detect  bots/crawlers/spiders via the user agent and other HTTP-headers. Currently able to detect 1,000's of bots/spiders/crawlers.InstallationRunpip install crawlerdetectUsageVariant 1fromcrawlerdetectimportCrawlerDetectcrawler_detect=CrawlerDetect()crawler_detect.isCrawler('Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)')# true if crawler user agent detectedVariant 2fromcrawlerdetectimportCrawlerDetectcrawler_detect=CrawlerDetect(user_agent='Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html)')crawler_detect.isCrawler()# true if crawler user agent detectedVariant 3fromcrawlerdetectimportCrawlerDetectcrawler_detect=CrawlerDetect(headers={'DOCUMENT_ROOT':'/home/test/public_html','GATEWAY_INTERFACE':'CGI/1.1','HTTP_ACCEPT':'*/*','HTTP_ACCEPT_ENCODING':'gzip, deflate','HTTP_CACHE_CONTROL':'no-cache','HTTP_CONNECTION':'Keep-Alive','HTTP_FROM':'googlebot(at)googlebot.com','HTTP_HOST':'www.test.com','HTTP_PRAGMA':'no-cache','HTTP_USER_AGENT':'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1500.71 Safari/537.36','PATH':'/bin:/usr/bin','QUERY_STRING':'order=closingDate','REDIRECT_STATUS':'200','REMOTE_ADDR':'127.0.0.1','REMOTE_PORT':'3360','REQUEST_METHOD':'GET','REQUEST_URI':'/?test=testing','SCRIPT_FILENAME':'/home/test/public_html/index.php','SCRIPT_NAME':'/index.php','SERVER_ADDR':'127.0.0.1','SERVER_ADMIN':'webmaster@test.com','SERVER_NAME':'www.test.com','SERVER_PORT':'80','SERVER_PROTOCOL':'HTTP/1.1','SERVER_SIGNATURE':'','SERVER_SOFTWARE':'Apache','UNIQUE_ID':'Vx6MENRxerBUSDEQgFLAAAAAS','PHP_SELF':'/index.php','REQUEST_TIME_FLOAT':1461619728.0705,'REQUEST_TIME':1461619728})crawler_detect.isCrawler()# true if crawler user agent detectedOutput the name of the bot that matched (if any)fromcrawlerdetectimportCrawlerDetectcrawler_detect=CrawlerDetect()crawler_detect.isCrawler('Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)')# true if crawler user agent detectedcrawler_detect.getMatches()# SosospiderContributingIf you find a bot/spider/crawler user agent that CrawlerDetect fails to detect, please submit a pull request with the regex pattern added to the array inproviders/crawlers.pyand add the failing user agent totests/crawlers.txt.Failing that, just create an issue with the user agent you have found, and we'll take it from there :)ES6 LibraryTo use this library with NodeJS or any ES6 application based, check outes6-crawler-detect..NET LibraryTo use this library in a .net standard (including .net core) based project, check outNetCrawlerDetect.Nette ExtensionTo use this library with the Nette framework, checkoutNetteCrawlerDetect.Ruby GemTo use this library with Ruby on Rails or any Ruby-based application, check outcrawler_detectgem.Parts of this class are based on the brilliantMobileDetect
Package: crawlerHelper
Introduction:This class can be used in crawler project. And it contain two function:1. proxies IP

2. hide headerIf also used pkl cache to speed up the abstract information from IP Pool
cache will be expired in one dayHow to use:
create new crawlerComponent object, and then,you can use:1. get_an_ip: get a random IP

2. get_a_header: get a random header

3. updateIpLib: update the ip library (original set as once per day)methods to useClass Version: 2.0.0 inhttps://gitlab.com/snippets/1873717
Package: crawlermaster
== Install:VCForPython27.msi (https://www.microsoft.com/en-us/download/details.aspx?id=44266)lxml-3.5.0.win32-py2.7.exe (https://pypi.python.org/pypi/lxml/3.5.0)$pip install crawlermaster== write csslist.json:example: techcrunch_news_csslist.json{"rawdata-converter-name":"techcrunch_news","local-html-file-pattern":{"strBasedir":"C:\\Users\\muchu\\Downloads","strSuffixes":"news.html"},"csslist":[{"name": "techcrunch-news-title","sampleUrl": "https://techcrunch.com/2016/06/02/apple-app-store-goes-down/","cssRule": "header.page-title h1.tweet-title::text","sampleAns": ["Apple App Store goes down"],"ansType": "exact"},{"name":"techcrunch-news-tags","sampleUrl":"https://techcrunch.com/2016/06/02/apple-app-store-goes-down/","cssRule":"div.tags a.tag::text","sampleAns":["Apps","Apple","iCloud","iTunes","app-store"],"ansType":"exact"},{"name":"techcrunch-news-pubtime","sampleUrl":"https://techcrunch.com/2016/06/02/apple-app-store-goes-down/","cssRule":"header.article-header div.byline time.timestamp::text","sampleAns":["4 hours ago"],"ansType":"exist"}]}== run test:$crawlermaster csslist.json== Uninstall:$pip uninstall crawlermaster
Package: crawler-py
CompatibilityCompatible Python 3.XCrawlers:DansTonChat:http://danstonchat.comVieDeMerde:http://viedemerde.frSeCoucherMoinsBete:http://secouchermoinsbete.frAn example of use is provided:test.pyExternal librarybeautifulsoup4requestsError code200:OK521:Parsing errorOther code:HTTP code error
Package: crawler-telefone-PT-BR-version
# Crawler de buscar por telefones em sites.Totally amateur and test project. This is my first project that I publish here. I won’t keep updating because it’s not my priority.In order for you to use this package, please consider changing in the “main.py” file the DOMAIN (DOMINIO) variable and the URL variable for the website you want to fetch phone numbers from.The script is all in Portuguese and I’m too lazy to change. Horrible code, enjoy
Package: crawles
0.3.3更新1 增加了请求参数类型自动识别2 增加了curl的请求参数对比当前功能1 将curl数据转换为普通代码，类代码和线程池代码2 可以将请求的数据进行格式化，请求参数可以直接是字符串3 优化了请求的响应体对象
Package: crawlframe
CrawlFrame: A Web Crawling frameworkBehold, the power of CrawlFrame:crawlf createapp <appname> -url http://<website>/
crawlf createpro <projectname>
crawlf start app:<name>
crawlf start project
crawlf stop app:<name>
crawlf stop project
crawlf stop <pid>CrawlFrameofficially supports python3.5+ .InstallationTo install CrawlFrame, simply usepip:$ pip install crawlframeDocumentationIn the construction...ChangedCHANGES.mdcrawlframe-1.0.3下载器并发方式变更crawlframe-1.0.2CRAWLFRAME_SURVIVE_SWITCH = True
CRAWLFRAME_SURVIVE_MAX = int
reload spiderCRAWLFRAME_SURVIVE_SWITCH = True
CRAWLFRAME_SURVIVE_MAX = int
设置两个参数
发出一定请求数之后, 自动重启爬虫. 避免内存溢出.
修复middle不能加载以及logger不能创建的bug.
BaseLogger改为单例模式.crawlframe-1.0.1crawlf createapp <appname> -url http://<website>/
crawlf createpro <projectname>
crawlf start app:<name>
crawlf start project
crawlf stop app:<name>
crawlf stop project
crawlf stop <pid>实际上以上命令只实现了start 与 stop.
但是已经能够在项目中使用了.
为了方便自己安装使用, 就先上传到 pypi 与 github 了.
Package: crawlib
Welcome tocrawlibDocumentationcrawlibis a board-first-search crawler framework for targeting-crawler (For those you know where’s your data located and how’s been organized). You just need to focus on the data model and html extraction logic, and let the framework do the rest of things like:duplicate filterrecursive crawlingstatus trackingperiodical updateCurrently it supports mongodb as backend storage only.Installcrawlibis released on PyPI, so all you need is:$pipinstallcrawlibTo upgrade to latest version:$pipinstall--upgradecrawlib
Package: crawl-image
# crawl_image## Introduction
- 多线程快速抓取网页所有图片资源到指定路径。
- 原理是抓取img标签的src，再整合域名成资源完整url，分发到程序线程去下载。## Examplefrom crawl_image.run_factory import run_for_url_list
run_for_url_list(‘C:/Users/xh/Desktop/url/url.txt’, img_save_path=’D:/crawl/image/real’, do_last_url_file_name=True)## Features
- 高速下载
- 抓取所有图片
- 自解网页编码
- 过滤图片类型
- 重构使用class交互，并建立run_factory，提供运行工厂，简化程序调用流程。
- 增加url列表文件爬取功能。
- 去重url数组。
- 使用url最后以’/’符号结束的字符串作为图片名称，以便检查重复下载的情况。## Communication
- 未来已来 203737026## Copyright and License
code for everything
Package: crawling-gocd
Crawling-GoCD is a library that works for crawling the goCD build histories of pipelines and calculate the metrics.Installation$ pip3 install crawling-gocdUsageInput configration in the filecrawling-gocd.yamlpipelines:
  - 
    name: account-management-normal-master
    calc_grouped_stages: 
      ci:
        - code-scan
        - test-integration
        - build
      qa:
        - flyway-qa
        - deploy-qa
    start_time: 2019-07-10 00:00:00
    end_time: 2019-08-12 23:59:59
  - 
    name: account-management-normal-release
    calc_grouped_stages: 
      uat:
        - flyway-uat
        - deploy-uat

global:
  start_time: 2019-07-01 00:00:00
  end_time: 2019-08-12 23:59:59Keys in the config file:pipeline nameis the string in the history API URL.pipeline calc_grouped_stagesincludes each phase needed to calculate metrics.Such as, if we want to calculate the deployment frequency for QA environment, and the QA deployment has two stages.If one of the two stages fails, determines QA deployment failed, so we configure the qa phase hasflyway-qa、deploy-qa.global start_timeandglobal end_time, determines the time slot for crawling pipeline histories.Also, there arepipeline start_timeandpipeline end_time, they have a high priority toglobal start_timeandglobal end_time.Code invokingfrom crawling_gocd.portal import Portal

  Portal().serve()Set environment variablesNeed set the environment variablesGOCD_SITE、GOCD_USER、GOCD_PASSWORDbefore running the application.ExpansibilitySo far the crawling URL is according to the goCD version 18.11.
Package: crawlio
crawlioAsynchronous web crawling and scraping with Python for minimalistsWarning: this project is under active development andnot yet production-ready!FeaturesCrawling: download an entire website in just a few secondsScraping: Customizable XPath & CSS data selectors (usingparsel)Zero-configuration: get up and running with ~5 LoCInterfaces: Web UI + JSON API powered by FastAPI & VueJSBuilt withasyncio,aiohttpand 🍺SetuppipinstallcrawlioUsageimportasynciofromcrawlioimportCrawler,Selectorbot=Crawler(url='https://quotes.toscrape.com/',selectors=[Selector('links','//a/@href'),Selector('heading',type='xpath',query='//h3//text()',process=lambdaitems:' '.join(items))])output=asyncio.run(bot.run())foriteminoutput["data"]:print(item)LicenseCopyright (C) 2021  Maximilian WolfThis program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.You should have received a copy of the GNU General Public License
along with this program.  If not, seehttps://www.gnu.org/licenses/.
Package: crawlmap
A python3 script to change your crawling logs to a mindmapIntroduction•Requirements•Installation•Usage•Examples•WikiCreated byLiodeusIntroductionThis tool is made to automate the process of creating a mindmap from crawling logs. This tool support logs from:Burp Suite(xml format)Gospider(json format)Zaproxy(har format)Requirementspython3 (sudo apt install python3)InstallationpipinstallcrawlmapUsagepython3 crawlmap.py --help
 _____                    _                       
/  __ \                  | |                      
| /  \/_ __ __ ___      _| |_ __ ___   __ _ _ __  
| |   | '__/ _` \ \ /\ / / | '_ ` _ \ / _` | '_ \ 
| \__/\ | | (_| |\ V  V /| | | | | | | (_| | |_) |
 \____/_|  \__,_| \_/\_/ |_|_| |_| |_|\__,_| .__/ 
                                           | |    
                                           |_|
                                            By Liodeus
  
usage: crawlmap.py [-h] -u URL [-b BURP] [-g GOSPIDER] [-z ZAPROXY] [-o OUT] [--exclude EXCLUDE] [--nofiles] [--params]

optional arguments:
  -h, --help            show this help message and exit
  -u URL, --url URL     Base URL to filter on
  -b BURP, --burp BURP  Output from BurSuite (xml)
  -g GOSPIDER, --gospider GOSPIDER
                        Output from Gospider (json)
  -z ZAPROXY, --zaproxy ZAPROXY
                        Output from Zaproxy (har)
  -o OUT, --out OUT     Output file
  --exclude EXCLUDE     Exclude extensions (Example : "png,svg,css,ico")
  --nofiles             Don't print files, only folders
  --params              Print path with parameters if any
  --params-only         Only print path with parametersExamplesGo to thewiki
Package: crawlMp
OverviewMain aim of this project is to provide simple tool for multiprocess crawling.It can be used either as a tool for python project or as a command line tool.ConceptThis package was written to serve general purpose of crawling various resources.To achieve that, Crawler interface needs to be adopted.Just by implementing this interface, other Crawlers can be created and used with crawlMp manager.Resource Crawler is then used with CrawlWorker.Every crawler first enters entry point (link) and extract hits and links.If specified, pipeline of actions is executed on every hit. By default, hits are collected in SIMPLE_MODE only and
that's the fastest method to crawl as well.If other metadata related to hit is required, use MODE_EXTENDED.Other workers can pick up and follow link(s) from shared list asynchronously.What is in the packageCrawler interfaceAction interfaceFile system Crawler, Actions with search capabilitiesscripts, providing easy access from command lineInstallationPippython3 -m pip install crawlMpGitgit clone https://github.com/domarm-comat/crawlMp.gitcd crawlMppython3 setup.py installUsage examplesScriptsShow help:search_fs_mp --helpSearch for .zip filessearch_fs_mp \\.zip$Get all .zip files in different directoriessearch_fs_mp \\.zip$ -l /home /usr/shareShow search summarysearch_fs_mp \\.zip$ -l /home /usr/share -osPython code (blocking)fromcrawlMp.crawlMpimportCrawlMpfromcrawlMp.crawlers.crawler_fsimportCrawlerSearchFsfromcrawlMp.snippets.outputimportprint_summarymanager=CrawlMp(CrawlerSearchFs,links=["/home"],num_proc=8,pattern="\.zip$")manager.start()print_summary(manager.results)Python code (callback)fromcrawlMp.crawlMpimportCrawlMpfromcrawlMp.crawlers.crawler_fsimportCrawlerSearchFsfromcrawlMp.snippets.outputimportprint_summarydefon_done(manager):print_summary(manager.results)manager=CrawlMp(CrawlerSearchFs,links=["/home"],num_proc=8,pattern="\.zip$")manager.start(on_done)Python code (actions)fromcrawlMp.crawlMpimportCrawlMpfromcrawlMp.actions.action_fsimportCopy,RemovefromcrawlMp.crawlers.crawler_fsimportCrawlerSearchFsfromcrawlMp.snippets.outputimportprint_summarydefon_done(manager):print_summary(manager.results)# Copy all found zip files and then remove them# It's just to demonstrate usage of actionsactions=(Copy(target_dir="/home/domarm/zip_files"),Remove())manager=CrawlMp(CrawlerSearchFs,links=["/home"],num_proc=8,pattern="\.zip$",actions=actions)manager.start(on_done)Code coverageRun pytests and code coverage by executing following commandscoveragerun-mpytest--rootdir./crawlMp/tests/
coveragereport>coverage.txt
Package: crawlMpGui
crawlMp-guiGraphical interface for crawlMp implemented in PyQt6.Results are paged into page_sized chunks.User can sort hits by column and apply multiple filter based on column type.Installationpython3 -m pip install crawlMpGuiIn case ofImportError: libQt6Widgets.so.6, execute:export LD_LIBRARY_PATH=/home/domarm/Qt/6.2.1/gcc_64/lib:$LD_LIBRARY_PATHUsage examplesScriptsShow help:search_fs_mp_gui --helpSearch for .zip filessearch_fs_mp_gui \\.zip$Get all .zip files in different directoriessearch_fs_mp_gui \\.zip$ -l /home /usr/sharePython codeimportsysfromPyQt6.QtWidgetsimportQApplicationfromcrawlMp.crawlMpimportCrawlMpfromcrawlMp.crawlers.crawler_fsimportCrawlerSearchFsfromcrawlMp.enumsimportModefromcrawlMpGui.widgets.results_widgetimportResultsWidgetapp=QApplication(sys.argv)w=ResultsWidget()w.show()manager=CrawlMp(CrawlerSearchFs,links=["/"],num_proc=8,pattern="\.zip$",mode=Mode.EXTENDED)manager.start(lambdam:w.sig_update_results.emit(m.results))app.exec()Icons attributionIcon made byRoundiconsfromwww.flaticon.comIcon made bySmaujfromwww.flaticon.comIcon made bydeemakdaksinafromwww.flaticon.com
Package: crawl-requests
1. Feactures:crawl_requests(like requests) can update ua and proxy automatically.2. Usage:>>>from crawl_requests import req_default>>>req = req_default.Req()>>>req.keep_req(method=’get’,url=’https://www.python.org’)<Response [200]>3. Tips:pip install crawl_requestsreq_default updates ua and proxy automatically.req need about [account of loading proxies]% minutes to load and test proxy to be used.
Package: crawl_trulia
Welcome to crawl_trulia DocumentationThis is a small project provide url route, html parse tools to crawl www.trulia.com.Quick LinksGitHub HomepagePyPI downloadInstallIssue submit and feature requestUsageA real example:>>>fromcrawl_trulia.urlencoderimporturlencoder>>>fromcrawl_trulia.htmlparserimporthtmlparser>>>fromcrawlib.spiderimportspider# install crawlib first# use address, city and zipcode>>>address="22 Yew Rd">>>city="Baltimore">>>zipcode="21221">>>url=urlencoder.by_address_city_and_zipcode(address,city,zipcode)>>>html=spider.get_html(url)>>>house_detail_data=htmlparser.get_house_detail(html)>>>house_detail_data{"features":{},"public_records":{"AC":"a/c","basement_type":"improved basement (finished)","bathroom":2,"build_year":1986,"county":"baltimore county","exterior_walls":"siding (alum/vinyl)","heating":"heat pump","lot_size":7505,"lot_size_unit":"sqft","partial_bathroom":1,"roof":"composition shingle","sqft":998}}# usually combination of address and zipcode is enough>>>address="2004 Birch Rd">>>zipcode="21221">>>url=urlencoder.by_address_and_zipcode(address,zipcode)>>>html=spider.get_html(url)>>>house_detail_data=htmlparser.get_house_detail(html)Installcrawl_truliais released on PyPI, so all you need is:$pipinstallcrawl_truliaTo upgrade to latest version:$pipinstall--upgradecrawl_trulia
Package: crawl-wx
crawl_wxDownload content fromwechat public content admin.Install Requirementpython >= 3.7Installpipinstallcrawl_wxUsageLoginhttps://mp.weixin.qq.com/cgi-bin/homeNavigate to #已群发消息#Open chrome developer toolCopy curl request,Save the copied to a file.run the commandcrawlwx--curl_file/path/to/curl_file--output/path/to/save
Package: crawl_zillow
Welcome to crawl_zillow DocumentationThis is a small project provide url route, html parse tools to crawl www.zillow.com.Quick LinksGitHub HomepagePyPI downloadInstallIssue submit and feature requestInstallcrawl_zillowis released on PyPI, so all you need is:$pipinstallcrawl_zillowTo upgrade to latest version:$pipinstall--upgradecrawl_zillow
Package: crawto-quality
Crawto-QualityA Collection of Tools for improving code qualityCrawto-DocA command-line-tool to add numpy style docstrings to your python projects.From reading just your code, its a docstring with a description, parameters, and and attributes & examples where applicable.While it cannot totally complete your documentation, Crawto-Doc can fill in as
much information you give it. Using mypy will fill in some missing pieces.WhyBecause documentation is a oft boring or an after-thought.
Many programs exist to turn documentation into websites or otherwise shareable
text.  The CrawtoDoc package exists to turn code into documentation.Fromclass DummyClassifier(MultiOutputMixin, ClassifierMixin, BaseEstimator):
    @_deprecate_positional_args
    def __init__(self, *, strategy="warn", random_state=None, constant=None):  
        self.strategy = strategy
        self.random_state = random_state
        self.constant = constantToclass DummyClassifier(MultiOutputMixin, ClassifierMixin, BaseEstimator):  
    """<#TODO Description>

    Parameters
    ----------
    strategy : <#TODO type definition>, default=warn
        <#TODO Description>

    random_state : <#TODO type definition>, default=None
        <#TODO Description>

    constant : <#TODO type definition>, default=None
        <#TODO Description>

    Attributes
    ----------
    sparse_output_ : <#TODO type definition>
        <#TODO Attribute Description>

    n_outputs_ : <#TODO type definition>
        <#TODO Attribute Description>

    n_features_in_ : <#TODO type definition>
        <#TODO Attribute Description>

    outputs_2d_ : <#TODO type definition>
        <#TODO Attribute Description>

    Examples
    --------
    >>> from crawto-quality import crawto_doc
    >>> example = DummyClassifier(strategy='warn', random_state=None, constant=None)
    >>> example.fit(X=<#TODO Example Value>, y=<#TODO Example Value>, sample_weight=None)
    <#TODO Method Return Value>
    >>> example.predict(X=<#TODO Example Value>)
    <#TODO Method Return Value>
    >>> example.predict_proba(X=<#TODO Example Value>)
    <#TODO Method Return Value>
    >>> example.predict_log_proba(X=<#TODO Example Value>)
    <#TODO Method Return Value>
    >>> example.score(X=<#TODO Example Value>, y=<#TODO Example Value>, sample_weight=None)
    <#TODO Method Return Value>
    """
Package: craygraph
CRayGraphA toolkit for defining dataflow-based frameworks. Intended for use in CRayNN (network definitions)
and CRayFlow (dataflow definitions).Installationvia PyPipip install craygraphvia gitCRayGraphcan be installed directly fromgitlab.com:pip install git+https://gitlab.com/craynn/craygraph.githowever, as repository updates quite often, it is recommend to clone the repository
and install the package in development mode:git clone git@gitlab.com:craynn/craygraph.git
cd craygraph/
pip install -e .UsageThis package provides three main functions:cragraph.graph: utilities for constructing easily readable definitions of directed acyclic graphs (DAGs);cragraph.meta: functions that help quickly adopt custom classes to work withcragraph.graph.DAG definition languageThe main feature ofcraygraphis intuitive and readable DAG definition language.Quick introductionBelow, functions likea, b, c, drepresent node (subgraph)
constructors, i.e.(*Node) -> Nodeor(*Node) -> list[Nodes],x, y, zrepresent input nodes.Tuple of functions = compositionachain(a,b,c,d)(x)is equivalent to:d(c(b(a(x))))and produces:List of functions = independent application:result=achain(a,[b,c],d)(x)is equivalent to:a_x=a(x)result=d(b(a_x),c(a_x))and results in the following graph:craygraph.graphcontains some helper functions.select[items](body)selects inputs according toitemsand appliesbodyselect[item](f)(*args)==f(args[item])for example:result=achain(select[0,-1](a,b),c)(x,y,z)is equivalent to:result=c(b(a(x,z)))which results in (nodeyis omitted since it is not used):with_inputs[items](body)is similar toselect,
but it takes inputs and replaces selected inputs with the result ofbody:result=achain(with_inputs[0,-1](a,b),c)(x,y,z)is equivalent to:result=c(b(a(x,z)))which results in:
Package: craynn
craynnYet Another toolkit for Neural Network slightly flavoured by Ultra-High Energy Cosmic Rays.PhilosophyCrayNNis highly influenced byLasange:Simplicity: Be easy to use, easy to understand and easy to extend, to facilitate use in research
Transparency: Do not hide Theano behind abstractions, directly process and return Theano expressions or Python / numpy data types
Modularity: Allow all parts (layers, regularizers, optimizers, ...) to be used independently of Lasagne
Pragmatism: Make common use cases easy, do not overrate uncommon cases
Restraint: Do not obstruct users with features they decide not to use
Focus: "Do one thing and do it well"Just replacetheanowithtensorflow.Installationvia PyPipip install craynnvia gitcraynncan be installed directly fromgitlab.com:pip install git+https://gitlab.com/craynn/craynn.githowever, as repository updates frequently, it is recommend to clone the repository
and install the package in development mode:git clone git@gitlab.com:craynn/craynn.git
cd craynn/
pip install -e .NB: don't forget to install proper version ofcraygraphin a similar manner:git clone git@gitlab.com:craynn/craygraph.git
cd craygraph/
pip install -e .UsageCheck out jupyter notebooks inexamples/.Quick guidecraynnis designed for rapidly defining networks of all sorts:fromcraynnimportnetwork,conv,max_poolnet=network((None,1,28,28))(conv(16),conv(24),max_pool(),conv(16),conv(24),max_pool(),conv(16),conv(24),max_pool(),)