Saravanan666/pypi-org huggingface dataset:
Package: tap-sailthru
tap-sailthruThis is aSingertap that produces JSON-formatted data
following theSinger
spec.This tap:Pulls data from theSailthru APIExtracts from the following sources to producestreams. Below is a list of all the streams available. See the streams file for a list of classes where each one has a constant indiciating if the stream's replication_method isINCREMENTALorFULL_TABLEand what the replication_key is, usuallymodify_timefield if it's incremental.Ad Targeter PlanBlastBlast RepeatBlast QueryBlast Save ListExport Purchase LogListUserIncludes a schema for each resource reflecting most recent tested data retrieved using the api. See theschemasfolder for details.Some streams incrementally pull data based on the previously saved state. See thebookmarking strategysection for more details.Bookmarking StrategySome endpoints in the Sailthru API support amodify_time(or similar) field that allows forINCREMENTALreplication. However, in most cases there is no such field available so most of the endpoints requireFULL_TABLEreplication. Furthermore, the API does not support pagination or filtering or ordering of any kind, so that should be taken into consideration for streams with aFULL_TABLEreplication.AuthenticationAPI key/secret can be retrieved by logging into your SailThru account then going to Settings > Setup > API & Postbacks > click lock icon to reveal credentials.Quick StartInstallClone this repository, and then install using setup.py. We recommend using a virtualenv:$virtualenv-ppython3venv
$sourcevenv/bin/activate
$pipinstall-e.Create your tap's config.json file. The tap config file for this tap should include these entries:start_date- (rfc3339 date string) the default value to use if no bookmark exists for an endpointuser_agent(string, required): Process and email for API logging purposes. Example: tap-sailthru <api_user_email@your_company.com>api_key(string, required): The API keyapi_secret(string, required): The API secretrequest_timeout(string/integer/float, optional): The time for which request should wait to get response and default request_timeout is 300 seconds.And the other values mentioned in the authentication section above.{"start_date":"2021-04-01T00:00:00Z","user_agent":"Stitch Tap (+support@stitchdata.com)","api_key":"<api_key>","api_secret":"<api_secret>","request_timeout":300}Run the Tap in Discovery Mode This creates a catalog.json for selecting objects/fields to integrate:tap-sailthru--configconfig.json--discover>catalog.jsonSee the Singer docs on discovery modehere.Run the Tap in Sync Mode (with catalog) and write out to state fileFor Sync mode:$tap-sailthru--configtap_config.json--catalogcatalog.json>>state.json
$tail-1state.json>state.json.tmp&&mvstate.json.tmpstate.jsonTo load to json files to verify outputs:$tap-sailthru--configtap_config.json--catalogcatalog.json|target-json>>state.json
$tail-1state.json>state.json.tmp&&mvstate.json.tmpstate.jsonTo pseudo-load to Stitch Import API with dry run:$tap-sailthru--configtap_config.json--catalogcatalog.json|target-stitch--configtarget_config.json--dry-run>>state.json
$tail-1state.json>state.json.tmp&&mvstate.json.tmpstate.jsonCopyright © 2018 Stitch
Package: tap-salesforce-connect
tap-salesforce-connecttap-salesforce-connectis a Singer tap for Salesforce'sConnect REST APIor Chatter API.Built with theMeltano Tap SDKfor Singer Taps.ConfigurationAccepted Config OptionsA full list of supported settings and capabilities for this
tap is available by running:tap-salesforce-connect--aboutConfigure using environment variablesThis Singer tap will automatically import any environment variables within the working directory's.envif the--config=ENVis provided, such that config values will be considered if a matching
environment variable is set either in the terminal context or in the.envfile.Source Authentication and AuthorizationRetrieve your client_id, client_secret, and instance_url by following the instructionshere.UsageYou can easily runtap-salesforce-connectby itself or in a pipeline usingMeltano.Executing the Tap Directlytap-salesforce-connect--version
tap-salesforce-connect--help
tap-salesforce-connect--configCONFIG--discover>./catalog.jsonDeveloper ResourcesFollow these instructions to contribute to this project.Initialize your Development Environmentpipxinstallpoetry
poetryinstallCreate and Run TestsCreate tests within thetap_salesforce_connect/testssubfolder and
then run:poetryrunpytestYou can also test thetap-salesforce-connectCLI interface directly usingpoetry run:poetryruntap-salesforce-connect--helpTesting withMeltanoNote:This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios.Next, install Meltano (if you haven't already) and any needed plugins:# Install meltanopipxinstallmeltano# Initialize meltano within this directorycdtap-salesforce-connect
meltanoinstallNow you can test and orchestrate using Meltano:# Test invocation:meltanoinvoketap-salesforce-connect--version# OR run a test `elt` pipeline:meltanoelttap-salesforce-connecttarget-jsonlSDK Dev GuideSee thedev guidefor more instructions on how to use the SDK to
develop your own taps and targets.
Package: tap-shiftbase
tap-shiftbasetap-shiftbaseis a Singer tap for shiftbase.Built with theMeltano Tap SDKfor Singer Taps.ConfigurationAccepted Config OptionsA full list of supported settings and capabilities for this
tap is available by running:tap-shiftbase--aboutConfigure using environment variablesThis Singer tap will automatically import any environment variables within the working directory's.envif the--config=ENVis provided, such that config values will be considered if a matching
environment variable is set either in the terminal context or in the.envfile.Source Authentication and AuthorizationUsageYou can easily runtap-shiftbaseby itself or in a pipeline usingMeltano.Executing the Tap Directlytap-shiftbase--version
tap-shiftbase--help
tap-shiftbase--configCONFIG--discover>./catalog.jsonDeveloper ResourcesFollow these instructions to contribute to this project.Initialize your Development Environmentpipxinstallpoetry
poetryinstallCreate and Run TestsCreate tests within thetap_shiftbase/testssubfolder and
then run:poetryrunpytestYou can also test thetap-shiftbaseCLI interface directly usingpoetry run:poetryruntap-shiftbase--helpTesting withMeltanoNote:This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios.Next, install Meltano (if you haven't already) and any needed plugins:# Install meltanopipxinstallmeltano# Initialize meltano within this directorycdtap-shiftbase
meltanoinstallNow you can test and orchestrate using Meltano:# Test invocation:meltanoinvoketap-shiftbase--version# OR run a test `elt` pipeline:meltanoelttap-shiftbasetarget-jsonlSDK Dev GuideSee thedev guidefor more instructions on how to use the SDK to
develop your own taps and targets.
Package: tap-shortcut
tap-shortcutSinger tap for Shortcut. Built with theMeltano Tap SDKfor Singer Taps.Capabilitiescatalogstatediscoveraboutstream-mapsSettingsSettingRequiredDefaultDescriptiontokenTrueNoneShortcut TokenA full list of supported settings and capabilities is available by running:tap-shortcut --aboutSource Authentication and AuthorizationSeehttps://developer.shortcut.com/api/rest/v3#Authentication.UsageYou can easily runtap-shortcutby itself or in a pipeline usingMeltano.Executing the Tap Directlytap-shortcut--version
tap-shortcut--help
tap-shortcut--configCONFIG--discover>./catalog.jsonDeveloper ResourcesInitialize your Development EnvironmentpipxinstallhatchCreate and Run TestsRun integration tests:hatchruntests:integrationYou can also test thetap-shortcutCLI interface directly:hatchrunsync:console----about--format=jsonTesting withMeltanoNote:This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios.Your project comes with a custommeltano.ymlproject file already created. Go ahead andinstall Meltanoif you haven't already.Install all pluginsmeltanoinstallCheck that the extractor is working properlymeltanoinvoketap-shortcut--versionExecute an ELT pipelinemeltanoruntap-shortcuttarget-jsonlSDK Dev GuideSee thedev guidefor more instructions on how to use the SDK to
develop your own taps and targets.
Package: tap-sleeper
tap-sleepertap-sleeperis aSingertap for theSleeperapi, built with theMeltano Tap SDK, which makes it easy to pull the latest news about or status of any NFL players, or granular information about your fantasy football league.Installationpipxinstalltap-sleeperConfigurationAccepted Config OptionsPropertyTypeRequiredDescriptionsportstringTrueProfessional sport league, ie nfl, nba, etcleague_idstringFalseUnique identifier for the sleeper leaguetrending_players_lookback_hoursintegerFalseTotal hours to lookback when requesting the current trending playerstrending_players_limitintegerFalseTotal number of players to return when requesting the current trending playersA full list of supported settings and capabilities for this
tap is available by running:tap-sleeper--aboutUsageYou can easily runtap-sleeperby itself or in a pipeline usingMeltano.Executing the Tap Directlytap-sleeper--version
tap-sleeper--help
tap-sleeper--configCONFIG--discover>./catalog.jsonDeveloper ResourcesInitialize your Development Environmentpipxinstallpoetry
poetryinstallCreate and Run TestsCreate tests within thetap_sleeper/testssubfolder and
then run:poetryrunpytestYou can also test thetap-sleeperCLI interface directly usingpoetry run:poetryruntap-sleeper--helpTesting withMeltanoNote:This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios.Your project comes with a custommeltano.ymlproject file already created. Open themeltano.ymland follow any"TODO"items listed in
the file.Next, install Meltano (if you haven't already) and any needed plugins:# Install meltanopipxinstallmeltano# Initialize meltano within this directorycdtap-sleeper
meltanoinstallNow you can test and orchestrate using Meltano:# Test invocation:meltanoinvoketap-sleeper--version# OR run a test `elt` pipeline:meltanoelttap-sleepertarget-jsonlSDK Dev GuideSee thedev guidefor more instructions on how to use the SDK to
develop your own taps and targets.
Package: tap-socketdev
tap-socketdevSinger tap forsocket.dev.Built with theMeltano Tap SDKfor Singer Taps.Capabilitiescatalogstatediscoveraboutstream-mapsSettingsDeveloper TODO:Declare tap settings here.A full list of supported settings and capabilities is available by running:tap-socketdev --aboutSource Authentication and AuthorizationDeveloper TODO:If your tap requires special access on the source system, or any special authentication requirements, provide those here.UsageYou can easily runtap-socketdevby itself or in a pipeline usingMeltano.Executing the Tap Directlytap-socketdev--version
tap-socketdev--help
tap-socketdev--configCONFIG--discover>./catalog.jsonDeveloper ResourcesDeveloper TODO:As a first step, scan the entire project for the text "TODO:" and complete any recommended steps, deleting the "TODO" references once completed.Initialize your Development Environmentpipxinstallpoetry
poetryinstallCreate and Run TestsCreate tests within thetestssubfolder and then run:poetryrunpytestYou can also test thetap-socketdevCLI interface directly usingpoetry run:poetryruntap-socketdev--helpTesting withMeltanoNote:This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios.Your project comes with a custommeltano.ymlproject file already created. Open themeltano.ymland follow any"TODO"items listed in
the file.Next, install Meltano (if you haven't already) and any needed plugins:# Install meltanopipxinstallmeltano# Initialize meltano within this directorycdtap-socketdev
meltanoinstallNow you can test and orchestrate using Meltano:# Test invocation:meltanoinvoketap-socketdev--version# OR run a test `elt` pipeline:meltanoelttap-socketdevtarget-jsonlSDK Dev GuideSee thedev guidefor more instructions on how to use the SDK to
develop your own taps and targets.
Package: tap-stackerhq
tap-stackerhqtap-stackerhqis a Singer tap for StackerHQ.Built with theMeltano Tap SDKfor Singer Taps.ConfigurationAccepted Config OptionsA full list of supported settings and capabilities for this
tap is available by running:tap-stackerhq--aboutConfigure using environment variablesThis Singer tap will automatically import any environment variables within the working directory's.envif the--config=ENVis provided, such that config values will be considered if a matching
environment variable is set either in the terminal context or in the.envfile.Source Authentication and AuthorizationUsageYou can easily runtap-stackerhqby itself or in a pipeline usingMeltano.Executing the Tap Directlytap-stackerhq--version
tap-stackerhq--help
tap-stackerhq--configCONFIG--discover>./catalog.jsonDeveloper ResourcesFollow these instructions to contribute to this project.Initialize your Development Environmentpipxinstallpoetry
poetryinstallCreate and Run TestsCreate tests within thetestssubfolder and
then run:poetryrunpytestYou can also test thetap-stackerhqCLI interface directly usingpoetry run:poetryruntap-stackerhq--helpTesting withMeltanoNote:This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios.Next, install Meltano (if you haven't already) and any needed plugins:# Install meltanopipxinstallmeltano# Initialize meltano within this directorycdtap-stackerhq
meltanoinstallNow you can test and orchestrate using Meltano:# Test invocation:meltanoinvoketap-stackerhq--version# OR run a test `elt` pipeline:meltanoelttap-stackerhqtarget-jsonlSDK Dev GuideSee thedev guidefor more instructions on how to use the SDK to
develop your own taps and targets.
Package: tap-stackexchange
tap-stackexchangeSinger tap for the StackExchange API.Built with theMeltano SDKfor Singer Taps and Targets.CapabilitiessynccatalogstatediscoverSettingsSettingRequiredDefaultDescriptionkeyFalseNonePass this to receive a higher request quotasiteFalsestackoverflow.comStackExchange sitetagsFalseNoneQuestion tagsstart_dateFalseNoneThe earliest record date to syncA full list of supported settings and capabilities is available by running:tap-stackexchange --aboutCustom filterThe StackExchange API supports a number ofcustom filtersthat can be used to
include or exclude certain fields from the response objects. This application has a baked-in filter with the following
parameters:includeParameterDescriptionquestion.comment_countThe number of comments on the questiontag.last_activity_dateThe date of the last activity on the tagunsafe=falseUpdate the baked-in filterTo update the baked-in filter, edit theFILTER_IDconstant intap_stackexchange/tap.py.To generate a new filter, use theTry Itbutton on theStackExchange API documentation, using the baked-in filter as thebaseparameter.Use a custom filterTo use a custom filter, set thefiltersetting to the filter ID. Note that if you use a custom filter, you will need to
use a custom catalog that includes the fields you want to sync. That is you will need toWrite the default catalog to a file:tap-stackexchange --discover > catalog.jsonEdit the catalog file to include the fields not included by the default API filterRun the tap with the custom catalog:tap-stackexchange --config config.json --catalog catalog.jsonInstallationpipxinstallgit+https://github.com/edgarrmondragon/tap-stackexchange.gitSource Authentication and AuthorizationRegister anew application on Stack Appsand copy the generatedkey.UsageYou can easily runtap-stackexchangeby itself or in a pipeline usingMeltano.Executing the Tap Directlytap-stackexchange--version
tap-stackexchange--help
tap-stackexchange--configCONFIG--discover>./catalog.jsonInitialize your Development Environmentpipxinstallpoetry
poetryinstallTesting withMeltanoNote:This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios.Your project comes with a custommeltano.ymlproject file already created. Open themeltano.ymland follow any"TODO"items listed in
the file.Next, install Meltano (if you haven't already) and any needed plugins:# Install meltanopipxinstallmeltano# Initialize meltano within this directorycdtap-stackexchange
meltanoinstallNow you can test and orchestrate using Meltano:# Test invocation:meltanoinvoketap-stackexchange--version# OR run a test `elt` pipeline:meltanoelttap-stackexchangetarget-sqlite--job_id=stackexchange-sqlite# Runtime configurationTAP_STACKEXCHANGE__LOAD_SCHEMA=dragon_ball_gt\TAP_STACKEXCHANGE_SITE=anime\TAP_STACKEXCHANGE_TAGS='["dragon-ball-gt"]'\meltanoelttap-stackexchangetarget-sqliteSDK Dev GuideSee thedev guidefor more instructions on how to use the SDK to
develop your own taps and targets.
Package: tap-tableau
tap-tableauThis is aSingertap that produces JSON-formatted data from theTableau REST APIfollowing theSinger
spec.StreamReplication KeyReplication StrategyConnectionsidFULLDatasourcesidINCREMENTALGroupsidFULLPermissionsidFULLProjectsidFULLSchedulesidFULLTasksidFULLUsersidFULLWorkbooksidINCREMENTALQuick startInstall>virtualenv-ppython3venv
>sourcevenv/bin/activate
>pipinstalltap-tableauCreate the config file, either (token,token_name) or (username,password) must
be specified for authentication.{"token_name":"My Tableau API access token","token":"abcdefg12345==","site_id":"my_tableau_site","host":"https://my_tableau_site.com","start_date":"2021-01-01T00:00:00Z"}Run discovery to generate the catalogtap-tableau--configconfig.json--discover>catalog.jsonIn the catalog.json file, select the streams to syncEach stream in the catalog.json file has a "schema" entry.  To select a stream to sync, add"selected": trueto that stream's "schema" entry.  For example, to sync the datasources stream:...
"tap_stream_id": "datasources",
"schema": {
  "selected": true,
  "schema": {
    "updated_at": {
      "format": "date-time",
      "type": [
        "null",
        "string"
      ]
    }
...Run the applicationtap-tableaucan be run with:tap-tableau--configconfig.json--catalogcatalog.jsonTo include a state file:tap-tableau--configconfig.json--catalogcatalog.json>state.json
tail-1state.json>state.json.tmp&&mvstate.json.tmpstate.json
Package: tap-teamwork
tap-teamworkAuthor: Stephen Bailey (sbailey@immuta.com)This is aSingertap forTeamwork.comthat produces JSON-formatted data following theSinger spec.It can generate a catalog of available data in teamwork and extract the following resources:ProjectsProject updatesProject milestonesProject risksLatest project activityPeopleTagsQuick StartInstallgitclonegit@github.com:immuta/tap-teamwork.gitcdtap-teamwork
pipinstall.Get an API key from Teamwork's website.Create the config file.There is a template you can use atconfig.json.example, just copy it toconfig.jsonin the repo root and insert your tokenRun the application to generate a catalog.tap-teamwork-cconfig.json--discover>catalog.jsonSelect the tables you'd like to replicateStep 4 generates a a file calledcatalog.jsonthat specifies all the available endpoints and fields. You'll need to open the file and select the ones you'd like to replicate. See theSinger guide on Catalog Formatfor more information on how tables are selected.Run it!tap-teamwork-cconfig.json--catalogcatalog.jsonAcknowledgementsWould like to acknowledge the folks at Fishtown Analytics whosetap-frameworkandtap-leverpackages formed the foundation for this package.Copyright © 2020 Immuta
Package: tap-terminusdb
tap-terminusdbThis is aSingertap that produces JSON-formatted data
following theSinger
spec.This tap:Pulls raw data fromTerminusDBExtract the specific streams in config.jsonOutputs the schema for each streamsIncrementally pulls data based on the input stateTo installtap-terminusdbcan be install via pip with Python >= 3.7:python3 -m pip install -U tap-terminusdbTo useYou can start a project in a directory using conjunction with TerminusDB easily by:terminusdb startprojectThis will create the config.json that stores information about the endpoint and database that you are connecting to. In addition you can add thestreamssettings with:terminusdb config streams=[MyClass1, MyClass2]Then you can data from TerminusDB into a Singer.io target. For details about how to use a Singer.io target you cansee here.For example, if you are extracting data from TerminusDB togoogle spreadsheet:tap-terminusdb -c config.json | target-gsheet -c gsheet-config.json
Package: tap-webcrm
tap-webcrminstallationinstall viapipusing the following command:pipinstalltap-webcrmbelow is an example of a validconfig.jsonfor this tap.Notesinger.io complianceThe tap supports--discoverand--catalogas of release v0.1. To simplify your life when working with this, use the pip packagesinger-discover:pipinstallhttps://github.com/chrisgoddard/singer-discover/archive/master.zipTables supportedAs of right now, Dreamdata only has use for theOpportunity,OrganisationandPersontables - but it would be trivial to add support for other ones and PRs are welcome.configthe API_TOKEN can be provided as the environment variablesWEBCRM_API_TOKENor directly in the configuration as seen below:{"api_token":"<API_TOKEN>"}
Package: tap-workato
tap-workatotap-workatois a Singer tap for Workato.Built with theMeltano Tap SDKfor Singer Taps.InstallationThis tap is installable via pypipipxinstalltap-workatoOr, if using via Meltano you can add configuration like so in themeltano.ymlfile:plugins:extractors:-name:tap-workatonamespace:tap_workatopip_url:-e .capabilities:-state-catalog-discoversettings:-name:user_tokenkind:password-name:user_emailkind:passwordand then run the following from the CLI:meltanoinstallextractortap-workatoConfigurationAccepted Config OptionsA full list of supported settings and capabilities for this
tap is available by running:tap-workato--aboutAvailable streams include:api_clientsapi_collectionconnectionscustomer_accounts*customer_api_access_profiles*customer_api_clients*customer_api_collections*customer_api_endpoints*customer_connections*customer_connections*customer_members*customer_recipes*customer_roles*foldersjobson_prem_agentson_prem_groupsrecipesrolesNotes:* The endpoints utilized by these streams are
Embedded Vendor APIs and require theoem_vendorprivilege in Workato.The workato Embedded API does not allow for extracting customer jobs
data at this time.Source Authentication and AuthorizationYou will need authentication tokens set up in your Workato account. Namely a user
email and a user token. See the
instructionshere.UsageYou can easily runtap-workatoby itself or in a pipeline usingMeltano.Executing the Tap Directlytap-workato--version
tap-workato--help
tap-workato--configCONFIG--discover>./catalog.jsonDeveloper ResourcesInitialize your Development Environmentpipxinstallpoetry
poetryinstallCreate and Run TestsCreate tests within thetap_workato/testssubfolder and
then run:poetryrunpytestYou can also test thetap-workatoCLI interface directly usingpoetry run:poetryruntap-workato--helpOther useful workflows are included in thetox.ini:poetryruntox-eformat
poetryruntox-elint
poetryruntox-epytestTesting withMeltanoNote:This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios.Your project comes with a custommeltano.ymlproject file already created. Open themeltano.ymland follow any"TODO"items listed in
the file.Next, install Meltano (if you haven't already) and any needed plugins:# Install meltanopipxinstallmeltano# Initialize meltano within this directorycdtap-workato
meltanoinstallNow you can test and orchestrate using Meltano:# Test invocation:meltanoinvoketap-workato--version# OR run a test `elt` pipeline:meltanoelttap-workatotarget-jsonlSDK Dev GuideSee thedev guidefor more instructions on how to use the SDK to
develop your own taps and targets.