Package: taskiq-fastapi
Taskiq + FastAPIThis repository has a code to integrate FastAPI with taskiq easily.Taskiq and FastAPI both have dependencies and this library makes it possible to depend onfastapi.Requestorstarlette.requests.HTTPConnectionin taskiq tasks.With this library you can easily re-use your fastapi dependencies in taskiq functions.How does it work?It adds startup functions to broker so it imports your fastapi application
and creates a single worker-wide Request and HTTPConnection objects that you depend on.THIS REQUEST IS NOT RELATED TO THE ACTUAL REQUESTS IN FASTAPI!
This request won't have actual data about the request you were handling while sending task.UsageHere we have an example of function that is being used by both taskiq's task and
fastapi's handler function.I have a script calledtest_script.pyso my app can be found attest_script:app.
We use strings to resolve application to bypass circular imports.Also, as you can see, we useTaskiqDependsfor Request. That's because
taskiq dependency resolver must know that this type must be injected. FastAPI disallow
Depends for Request type. That's why we useTaskiqDepends.fromfastapiimportFastAPI,RequestfrompydanticimportBaseModelfromredis.asyncioimportConnectionPool,RedisfromfastapiimportDependsasFastAPIDependsfromtaskiqimportTaskiqDependsimporttaskiq_fastapifromtaskiqimportZeroMQBrokerbroker=ZeroMQBroker()app=FastAPI()@app.on_event("startup")asyncdefapp_startup():###################### IMPORTANT NOTE    ####################### If you won't check that this is not# a worker process, you'll# create an infinite recursion. Because in worker processes# fastapi startup will be called.ifnotbroker.is_worker_process:print("Starting broker")awaitbroker.startup()print("Creating redis pool")app.state.redis_pool=ConnectionPool.from_url("redis://localhost")@app.on_event("shutdown")asyncdefapp_shutdown():###################### IMPORTANT NOTE    ####################### If you won't check that this is not# a worker process, you'll# create an infinite recursion. Because in worker processes# fastapi startup will be called.ifnotbroker.is_worker_process:print("Shutting down broker")awaitbroker.shutdown()print("Stopping redis pool")awaitapp.state.redis_pool.disconnect()# Here we call our magic function.taskiq_fastapi.init(broker,"test_script:app")# We use TaskiqDepends here, because if we use FastAPIDepends fastapi# initialization will fail.defget_redis_pool(request:Request=TaskiqDepends())->ConnectionPool:returnrequest.app.state.redis_pool@broker.taskasyncdefmy_redis_task(key:str,val:str,# Here we depend using TaskiqDepends.# Please use TaskiqDepends for all tasks to be resolved correctly.# Or dependencies won't be injected.pool:ConnectionPool=TaskiqDepends(get_redis_pool),):asyncwithRedis(connection_pool=pool)asredis:awaitredis.set(key,val)print("Value set.")classMyVal(BaseModel):key:strval:str@app.post("/val")asyncdefsetval_endpoint(val:MyVal)->None:awaitmy_redis_task.kiq(key=val.key,val=val.val,)print("Task sent")@app.get("/val")asyncdefgetval_endpoint(key:str,pool:ConnectionPool=FastAPIDepends(get_redis_pool),)->str:asyncwithRedis(connection_pool=pool,decode_responses=True)asredis:returnawaitredis.get(key)Manually update dependency contextWhen usingInMemoryBrokerit may be required to update the dependency context manually. This may also be useful when setting up tests.importtaskiq_fastapifromtaskiqimportInMemoryBrokerbroker=InMemoryBroker()app=FastAPI()taskiq_fastapi.init(broker,"test_script:app")taskiq_fastapi.populate_dependency_context(broker,app)