Package: selenium-wire
Selenium Wire extendsSelenium’sPython bindings to give you access to the underlying requests made by the browser. You author your code in the same way as you do with Selenium, but you get extra APIs for inspecting requests and responses and making changes to them on the fly.Simple Examplefromseleniumwireimportwebdriver# Import from seleniumwire# Create a new instance of the Chrome driverdriver=webdriver.Chrome()# Go to the Google home pagedriver.get('https://www.google.com')# Access requests via the `requests` attributeforrequestindriver.requests:ifrequest.response:print(request.url,request.response.status_code,request.response.headers['Content-Type'])Prints:https://www.google.com/200text/html;charset=UTF-8https://www.google.com/images/branding/googlelogo/2x/googlelogo_color_120x44dp.png200image/pnghttps://consent.google.com/status?continue=https://www.google.com&pc=s&timestamp=1531511954&gl=GB204text/html;charset=utf-8https://www.google.com/images/branding/googlelogo/2x/googlelogo_color_272x92dp.png200image/pnghttps://ssl.gstatic.com/gb/images/i2_2ec824b0.png200image/pnghttps://www.google.com/gen_204?s=webaft&t=aft&atyp=csi&ei=kgRJW7DBONKTlwTK77wQ&rt=wsrt.366,aft.58,prt.58204text/html;charset=UTF-8...FeaturesPure Python, user-friendly APIHTTP and HTTPS requests capturedIntercept requests and responsesModify headers, parameters, body content on the flyCapture websocket messagesHAR format supportedProxy server supportCompatibiltyPython 3.7+Selenium 4.0.0+Chrome, Firefox, Edge and Remote Webdriver supportedTable of ContentsInstallationBrowser SetupOpenSSLCreating the WebdriverAccessing RequestsRequest ObjectsResponse ObjectsIntercepting Requests and ResponsesExample: Add a request headerExample: Replace an existing request headerExample: Add a response headerExample: Add a request parameterExample: Update JSON in a POST request bodyExample: Basic authenticationExample: Block a requestExample: Mock a responseUnset an interceptorLimiting Request CaptureRequest StorageIn-Memory StorageProxiesSOCKSSwitching DynamicallyBot DetectionCertificatesUsing Your Own CertificateAll OptionsLicenseInstallationInstall using pip:pipinstallselenium-wireIf you get an error about not being able to build cryptography you may be running an old version of pip. Try upgrading pip withpython-mpip install--upgradepipand then re-run the above command.Browser SetupNo specific configuration should be necessary except to ensure that you have downloaded the relevent webdriver executable for your browser and placed it somewhere on your system PATH.Downloadwebdriver for ChromeDownloadwebdriver for FirefoxDownloadwebdriver for EdgeOpenSSLSelenium Wire requires OpenSSL for decrypting HTTPS requests. This is probably already installed on your system (you can check by runningopenssl versionon the command line). If it’s not installed you can install it with:Linux# For apt based Linux systemssudoaptinstallopenssl# For RPM based Linux systemssudoyuminstallopenssl# For Linux alpinesudoapkaddopensslMacOSbrewinstallopensslWindowsNo installation is required.Creating the WebdriverEnsure that you importwebdriverfrom theseleniumwirepackage:fromseleniumwireimportwebdriverThen just instantiate the webdriver as you would if you were using Selenium directly. You can pass in any desired capabilities or browser specific options - such as the executable path, headless mode etc. Selenium Wire also has it’sown optionsthat can be passed in theseleniumwire_optionsattribute.# Create the driver with no options (use defaults)driver=webdriver.Chrome()# Or create using browser specific options and/or seleniumwire_options optionsdriver=webdriver.Chrome(options=webdriver.ChromeOptions(...),seleniumwire_options={...})Note that for sub-packages ofwebdriver, you should continue to import these directly fromselenium. For example, to importWebDriverWait:# Sub-packages of webdriver must still be imported from `selenium` itselffromselenium.webdriver.support.uiimportWebDriverWaitRemote WebdriverSelenium Wire has limited support for using the remote webdriver client. When you create an instance of the remote webdriver, you need to specify the hostname or IP address of the machine (or container) running Selenium Wire. This allows the remote instance to communicate back to Selenium Wire with its requests and responses.options={'addr':'hostname_or_ip'# Address of the machine running Selenium Wire. Explicitly use 127.0.0.1 rather than localhost if remote session is running locally.}driver=webdriver.Remote(command_executor='http://www.example.com',seleniumwire_options=options)If the machine running the browser needs to use a different address to talk to the machine running Selenium Wire you need to configure the browser manually.This issuegoes into more detail.Accessing RequestsSelenium Wire captures all HTTP/HTTPS traffic made by the browser[1]. The following attributes provide access to requests and responses.driver.requestsThe list of captured requests in chronological order.driver.last_requestConvenience attribute for retrieving the most recently captured request. This is more efficient than usingdriver.requests[-1].driver.wait_for_request(pat, timeout=10)This method will wait until it sees a request matching a pattern. Thepatattribute will be matched within the request URL.patcan be a simple substring or a regular expression. Note thatdriver.wait_for_request()doesn’tmakea request, it justwaitsfor a previous request made by some other action and it will return the first request it finds. Also note that sincepatcan be a regular expression, you must escape special characters such as question marks with a slash. ATimeoutExceptionis raised if no match is found within the timeout period.For example, to wait for an AJAX request to return after a button is clicked:# Click a button that triggers a background request to https://server/api/products/12345/button_element.click()# Wait for the request/response to completerequest=driver.wait_for_request('/api/products/12345/')driver.harA JSON formatted HAR archive of HTTP transactions that have taken place. HAR capture is turned off by default and you must set theenable_haroptiontoTruebefore usingdriver.har.driver.iter_requests()Returns an iterator over captured requests. Useful when dealing with a large number of requests.driver.request_interceptorUsed to set a request interceptor. SeeIntercepting Requests and Responses.driver.response_interceptorUsed to set a response interceptor.Clearing RequestsTo clear previously captured requests and HAR entries, usedel:deldriver.requests[1]Selenium Wire ignores OPTIONS requests by default, as these are typically uninteresting and just add overhead. If you want to capture OPTIONS requests, you need to set theignore_http_methodsoptionto[].Request ObjectsRequest objects have the following attributes.bodyThe request body asbytes. If the request has no body the value ofbodywill be empty, i.e.b''.certInformation about the server SSL certificate in dictionary format. Empty for non-HTTPS requests.dateThe datetime the request was made.headersA dictionary-like object of request headers. Headers are case-insensitive and duplicates are permitted. Asking forrequest.headers['user-agent']will return the value of theUser-Agentheader. If you wish to replace a header, make sure you delete the existing header first withdelrequest.headers['header-name'], otherwise you’ll create a duplicate.hostThe request host, e.g.www.example.commethodThe HTTP method, e.g.GETorPOSTetc.paramsA dictionary of request parameters. If a parameter with the same name appears more than once in the request, it’s value in the dictionary will be a list.pathThe request path, e.g./some/path/index.htmlquerystringThe query string, e.g.foo=bar&spam=eggsresponseTheresponse objectassociated with the request. This will beNoneif the request has no response.urlThe request URL, e.g.https://www.example.com/some/path/index.html?foo=bar&spam=eggsws_messagesWhere the request is a websocket handshake request (normally with a URL startingwss://) thenws_messageswill contain a list of any websocket messages sent and received. SeeWebSocketMessage Objects.Request objects have the following methods.abort(error_code=403)Trigger immediate termination of the request with the supplied error code. For use within request interceptors. SeeExample: Block a request.create_response(status_code,headers=(),body=b'')Create a response and return it without sending any data to the remote server. For use within request interceptors. SeeExample: Mock a response.WebSocketMessage ObjectsThese objects represent websocket messages sent between the browser and server and vice versa. They are held in a list byrequest.ws_messageson websocket handshake requests. They have the following attributes.contentThe message content which may be eitherstrorbytes.dateThe datetime of the message.from_clientTruewhen the message was sent by the client andFalsewhen sent by the server.Response ObjectsResponse objects have the following attributes.bodyThe response body asbytes. If the response has no body the value ofbodywill be empty, i.e.b''. Sometimes the body may have been compressed by the server. You can prevent this with thedisable_encodingoption. To manually decode an encoded response body you can do:fromseleniumwire.utilsimportdecodebody=decode(response.body,response.headers.get('Content-Encoding','identity'))dateThe datetime the response was received.headersA dictionary-like object of response headers. Headers are case-insensitive and duplicates are permitted. Asking forresponse.headers['content-length']will return the value of theContent-Lengthheader. If you wish to replace a header, make sure you delete the existing header first withdelresponse.headers['header-name'], otherwise you’ll create a duplicate.reasonThe reason phrase, e.g.OKorNot Foundetc.status_codeThe status code of the response, e.g.200or404etc.Intercepting Requests and ResponsesAs well as capturing requests and responses, Selenium Wire allows you to modify them on the fly using interceptors. An interceptor is a function that gets invoked with requests and responses as they pass through Selenium Wire. Within an interceptor you can modify the request and response as you see fit.You set your interceptor functions using thedriver.request_interceptoranddriver.response_interceptorattributes before you start using the driver. A request interceptor should accept a single argument for the request. A response interceptor should accept two arguments, one for the originating request and one for the response.Example: Add a request headerdefinterceptor(request):request.headers['New-Header']='Some Value'driver.request_interceptor=interceptordriver.get(...)# All requests will now contain New-HeaderHow can I check that a header has been set correctly? You can print the headers from captured requests after the page has loaded usingdriver.requests, or alternatively point the webdriver athttps://httpbin.org/headerswhich will echo the request headers back to the browser so you can view them.Example: Replace an existing request headerDuplicate header names are permitted in an HTTP request, so before setting the replacement header you must first delete the existing header usingdellike in the following example, otherwise two headers with the same name will exist (request.headersis a special dictionary-like object that allows duplicates).definterceptor(request):delrequest.headers['Referer']# Remember to delete the header firstrequest.headers['Referer']='some_referer'# Spoof the refererdriver.request_interceptor=interceptordriver.get(...)# All requests will now use 'some_referer' for the refererExample: Add a response headerdefinterceptor(request,response):# A response interceptor takes two argsifrequest.url=='https://server.com/some/path':response.headers['New-Header']='Some Value'driver.response_interceptor=interceptordriver.get(...)# Responses from https://server.com/some/path will now contain New-HeaderExample: Add a request parameterRequest parameters work differently to headers in that they are calculated when they are set on the request. That means that you first have to read them, then update them, and then write them back - like in the following example. Parameters are held in a regular dictionary, so parameters with the same name will be overwritten.definterceptor(request):params=request.paramsparams['foo']='bar'request.params=paramsdriver.request_interceptor=interceptordriver.get(...)# foo=bar will be added to all requestsExample: Update JSON in a POST request bodyimportjsondefinterceptor(request):ifrequest.method=='POST'andrequest.headers['Content-Type']=='application/json':# The body is in bytes so convert to a stringbody=request.body.decode('utf-8')# Load the JSONdata=json.loads(body)# Add a new propertydata['foo']='bar'# Set the JSON back on the requestrequest.body=json.dumps(data).encode('utf-8')# Update the content lengthdelrequest.headers['Content-Length']request.headers['Content-Length']=str(len(request.body))driver.request_interceptor=interceptordriver.get(...)Example: Basic authenticationIf a site requires a username/password, you can use a request interceptor to add authentication credentials to each request. This will stop the browser from displaying a username/password pop-up.importbase64auth=(base64.encodebytes('my_username:my_password'.encode()).decode().strip())definterceptor(request):ifrequest.host=='host_that_needs_auth':request.headers['Authorization']=f'Basic{auth}'driver.request_interceptor=interceptordriver.get(...)# Credentials will be transmitted with every request to "host_that_needs_auth"Example: Block a requestYou can userequest.abort()to block a request and send an immediate response back to the browser. An optional error code can be supplied. The default is 403 (forbidden).definterceptor(request):# Block PNG, JPEG and GIF imagesifrequest.path.endswith(('.png','.jpg','.gif')):request.abort()driver.request_interceptor=interceptordriver.get(...)# Requests for PNG, JPEG and GIF images will result in a 403 ForbiddenExample: Mock a responseYou can userequest.create_response()to send a custom reply back to the browser. No data will be sent to the remote server.definterceptor(request):ifrequest.url=='https://server.com/some/path':request.create_response(status_code=200,headers={'Content-Type':'text/html'},# Optional headers dictionarybody='<html>Hello World!</html>'# Optional body)driver.request_interceptor=interceptordriver.get(...)# Requests to https://server.com/some/path will have their responses mockedHave any other examples you think could be useful? Feel free to submit a PR.Unset an interceptorTo unset an interceptor, usedel:deldriver.request_interceptordeldriver.response_interceptorLimiting Request CaptureSelenium Wire works by redirecting browser traffic through an internal proxy server it spins up in the background. As requests flow through the proxy they are intercepted and captured. Capturing requests can slow things down a little but there are a few things you can do to restrict what gets captured.driver.scopesThis accepts a list of regular expressions that will match the URLs to be captured. It should be set on the driver before making any requests. When empty (the default) all URLs are captured.driver.scopes=['.*stackoverflow.*','.*github.*']driver.get(...)# Start making requests# Only request URLs containing "stackoverflow" or "github" will now be capturedNote that even if a request is out of scope and not captured, it will still travel through Selenium Wire.seleniumwire_options.disable_captureUse this option to switch off request capture. Requests will still pass through Selenium Wire and through any upstream proxy you have configured but they won’t be intercepted or stored. Request interceptors will not execute.options={'disable_capture':True# Don't intercept/store any requests}driver=webdriver.Chrome(seleniumwire_options=options)seleniumwire_options.exclude_hostsUse this option to bypass Selenium Wire entirely. Any requests made to addresses listed here will go direct from the browser to the server without involving Selenium Wire. Note that if you’ve configured an upstream proxy then these requests will also bypass that proxy.options={'exclude_hosts':['host1.com','host2.com']# Bypass Selenium Wire for these hosts}driver=webdriver.Chrome(seleniumwire_options=options)request.abort()You can abort a request early by usingrequest.abort()from within arequest interceptor. This will send an immediate response back to the client without the request travelling any further. You can use this mechanism to block certain types of requests (e.g. images) to improve page load performance.definterceptor(request):# Block PNG, JPEG and GIF imagesifrequest.path.endswith(('.png','.jpg','.gif')):request.abort()driver.request_interceptor=interceptordriver.get(...)# Start making requestsRequest StorageCaptured requests and responses are stored in the system temp folder by default (that’s/tmpon Linux and usuallyC:\Users\<username>\AppData\Local\Tempon Windows) in a sub-folder called.seleniumwire. To change where the.seleniumwirefolder gets created you can use therequest_storage_base_diroption:options={'request_storage_base_dir':'/my/storage/folder'# .seleniumwire will get created here}driver=webdriver.Chrome(seleniumwire_options=options)In-Memory StorageSelenium Wire also supports storing requests and responses in memory only, which may be useful in certain situations - e.g. if you’re running short lived Docker containers and don’t want the overhead of disk persistence. You can enable in-memory storage by setting therequest_storageoption tomemory:options={'request_storage':'memory'# Store requests and responses in memory only}driver=webdriver.Chrome(seleniumwire_options=options)If you’re concerned about the amount of memory that may be consumed, you can restrict the number of requests that are stored with therequest_storage_max_sizeoption:options={'request_storage':'memory','request_storage_max_size':100# Store no more than 100 requests in memory}driver=webdriver.Chrome(seleniumwire_options=options)When the max size is reached, older requests are discarded as newer requests arrive. Keep in mind that if you restrict the number of requests being stored, requests may have disappeared from storage by the time you come to retrieve them withdriver.requestsordriver.wait_for_request()etc.ProxiesIf the site you are accessing sits behind a proxy server you can tell Selenium Wire about that proxy server in the options you pass to the webdriver.The configuration takes the following format:options={'proxy':{'http':'http://192.168.10.100:8888','https':'https://192.168.10.100:8888','no_proxy':'localhost,127.0.0.1'}}driver=webdriver.Chrome(seleniumwire_options=options)To use HTTP Basic Auth with your proxy, specify the username and password in the URL:options={'proxy':{'https':'https://user:pass@192.168.10.100:8888',}}For authentication other than Basic, you can supply the full value for theProxy-Authorizationheader using thecustom_authorizationoption. For example, if your proxy used the Bearer scheme:options={'proxy':{'https':'https://192.168.10.100:8888',# No username or password used'custom_authorization':'Bearer mytoken123'# Custom Proxy-Authorization header value}}More info on theProxy-Authorizationheader can be foundhere.The proxy configuration can also be loaded through environment variables calledHTTP_PROXY,HTTPS_PROXYandNO_PROXY:$exportHTTP_PROXY="http://192.168.10.100:8888"$exportHTTPS_PROXY="https://192.168.10.100:8888"$exportNO_PROXY="localhost,127.0.0.1"SOCKSUsing a SOCKS proxy is the same as using an HTTP based one but you set the scheme tosocks5:options={'proxy':{'http':'socks5://user:pass@192.168.10.100:8888','https':'socks5://user:pass@192.168.10.100:8888','no_proxy':'localhost,127.0.0.1'}}driver=webdriver.Chrome(seleniumwire_options=options)You can leave out theuserandpassif your proxy doesn’t require authentication.As well assocks5, the schemessocks4andsocks5hare supported. Usesocks5hwhen you want DNS resolution to happen on the proxy server rather than on the client.Using Selenium Wire with TorSeethis exampleif you want to run Selenium Wire with Tor.Switching DynamicallyIf you want to change the proxy settings for an existing driver instance, use thedriver.proxyattribute:driver.get(...)# Using some initial proxy# Change the proxydriver.proxy={'https':'https://user:pass@192.168.10.100:8888',}driver.get(...)# These requests will use the new proxyTo clear a proxy, setdriver.proxyto an empty dict{}.This mechanism also supports theno_proxyandcustom_authorizationoptions.Bot DetectionSelenium Wire will integrate withundetected-chromedriverif it finds it in your environment. This library will transparently modify ChromeDriver to prevent it from triggering anti-bot measures on websites.If you wish to take advantage of this make sure you have undetected_chromedriver installed:pipinstallundetected-chromedriverThen in your code, import theseleniumwire.undetected_chromedriverpackage:importseleniumwire.undetected_chromedriverasucchrome_options=uc.ChromeOptions()driver=uc.Chrome(options=chrome_options,seleniumwire_options={})CertificatesSelenium Wire uses it’s own root certificate to decrypt HTTPS traffic. It is not normally necessary for the browser to trust this certificate because Selenium Wire tells the browser to add it as an exception. This will allow the browser to function normally, but it will display a “Not Secure” message (and/or unlocked padlock) in the address bar. If you wish to get rid of this message you can install the root certificate manually.You can download the root certificatehere. Once downloaded, navigate to “Certificates” in your browser settings and import the certificate in the “Authorities” section.Using Your Own CertificateIf you would like to use your own root certificate you can supply the path to the certificate and the private key using theca_certandca_keyoptions.If you do specify your own certificate, be sure to manually delete Selenium Wire’stemporary storage folder. This will clear out any existing certificates that may have been cached from previous runs.All OptionsA summary of all options that can be passed to Selenium Wire via theseleniumwire_optionswebdriver attribute.addrThe IP address or hostname of the machine running Selenium Wire. This defaults to 127.0.0.1. You may want to change this to the public IP of the machine (or container) if you’re using theremote webdriver.options={'addr':'192.168.0.10'# Use the public IP of the machine}driver=webdriver.Chrome(seleniumwire_options=options)auto_configWhether Selenium Wire should auto-configure the browser for request capture.Trueby default.ca_certThe path to a root (CA) certificate if you prefer to use your own certificate rather than use the default.options={'ca_cert':'/path/to/ca.crt'# Use own root certificate}driver=webdriver.Chrome(seleniumwire_options=options)ca_keyThe path to the private key if you’re using your own root certificate. The key must always be supplied when using your own certificate.options={'ca_key':'/path/to/ca.key'# Path to private key}driver=webdriver.Chrome(seleniumwire_options=options)disable_captureDisable request capture. WhenTruenothing gets intercepted or stored.Falseby default.options={'disable_capture':True# Don't intercept/store any requests.}driver=webdriver.Chrome(seleniumwire_options=options)disable_encodingAsk the server to send back uncompressed data.Falseby default. WhenTruethis sets theAccept-Encodingheader toidentityfor all outbound requests. Note that it won’t always work - sometimes the server may ignore it.options={'disable_encoding':True# Ask the server not to compress the response}driver=webdriver.Chrome(seleniumwire_options=options)enable_harWhenTruea HAR archive of HTTP transactions will be kept which can be retrieved withdriver.har.Falseby default.options={'enable_har':True# Capture HAR data, retrieve with driver.har}driver=webdriver.Chrome(seleniumwire_options=options)exclude_hostsA list of addresses for which Selenium Wire should be bypassed entirely. Note that if you have configured an upstream proxy then requests to excluded hosts will also bypass that proxy.options={'exclude_hosts':['google-analytics.com']# Bypass these hosts}driver=webdriver.Chrome(seleniumwire_options=options)ignore_http_methodsA list of HTTP methods (specified as uppercase strings) that should be ignored by Selenium Wire and not captured. The default is['OPTIONS']which ignores all OPTIONS requests. To capture all request methods, setignore_http_methodsto an empty list:options={'ignore_http_methods':[]# Capture all requests, including OPTIONS requests}driver=webdriver.Chrome(seleniumwire_options=options)portThe port number that Selenium Wire’s backend listens on. You don’t normally need to specify a port as a random port number is chosen automatically.options={'port':9999# Tell the backend to listen on port 9999 (not normally necessary to set this)}driver=webdriver.Chrome(seleniumwire_options=options)proxyThe upstreamproxy serverconfiguration if you’re using a proxy.options={'proxy':{'http':'http://user:pass@192.168.10.100:8888','https':'https://user:pass@192.168.10.100:8889','no_proxy':'localhost,127.0.0.1'}}driver=webdriver.Chrome(seleniumwire_options=options)request_storageThe type of storage to use. Selenium Wire defaults to disk based storage, but you can switch to in-memory storage by setting this option tomemory:options={'request_storage':'memory'# Store requests and responses in memory only}driver=webdriver.Chrome(seleniumwire_options=options)request_storage_base_dirThe base location where Selenium Wire stores captured requests and responses when using its default disk based storage. This defaults to the system temp folder (that’s/tmpon Linux and usuallyC:\Users\<username>\AppData\Local\Tempon Windows). A sub-folder called.seleniumwirewill get created here to store the captured data.options={'request_storage_base_dir':'/my/storage/folder'# .seleniumwire will get created here}driver=webdriver.Chrome(seleniumwire_options=options)request_storage_max_sizeThe maximum number of requests to store when using in-memory storage. Unlimited by default. This option currently has no effect when using the default disk based storage.options={'request_storage':'memory','request_storage_max_size':100# Store no more than 100 requests in memory}driver=webdriver.Chrome(seleniumwire_options=options)suppress_connection_errorsWhether to suppress connection related tracebacks.Trueby default, meaning that harmless errors that sometimes occur at browser shutdown do not alarm users. When suppressed, the connection error message is logged at DEBUG level without a traceback. Set toFalseto allow exception propagation and see full tracebacks.options={'suppress_connection_errors':False# Show full tracebacks for any connection errors}driver=webdriver.Chrome(seleniumwire_options=options)verify_sslWhether SSL certificates should be verified.Falseby default, which prevents errors with self-signed certificates.options={'verify_ssl':True# Verify SSL certificates but beware of errors with self-signed certificates}driver=webdriver.Chrome(seleniumwire_options=options)LicenseMITHistory5.1.0 (2022-10-15)Drop support for Selenium<4.0.0.Drop support for SSLv2 and SSLv3.Fix bug where setting non-string header values would cause an interceptor to fail.5.0.0 (2022-09-26)Add support for Microsoft Edge to webdriverDrop support for Python 3.6Fix compatibility issue with PyOpenSSL4.6.5 (2022-07-09)Fix compatibility issue with DesiredCapabilities and older versions of the Chrome webdriver API.Fix bug where verify_ssl would assume the inverse of the boolean passed (it was the wrong way round).Minor update to support Python 3.10.Minor README updates.4.6.4 (2022-05-11)Fix bug where setting an interceptor would break websocket requests.4.6.3 (2022-03-13)Fix bug with dynamic switching of upstream proxy.4.6.2 (2022-02-25)Fix import error with missing TouchActions in Selenium>4.1.04.6.1 (2022-02-21)Fix compatibility issue with undetected_chromedriver.Handle occasional unpickle error when loading captured requests from disk.4.6.0 (2022-01-10)Configurable root certificate and private key.Fix bug where it was not possible to clear a proxy once set.4.5.6 (2021-11-26)Fix bug where using the chrome_options argument would prevent request capture.Fix issue where Proxy-Connection header was being propagated.4.5.5 (2021-11-13)Fix issue where missing ‘packaging’ module prevents Selenium Wire from starting.Fix deprecation warnings with desired capabilities.4.5.4 (2021-10-23)Fix bug preventing request capture when using Firefox and Selenium >= 4.0.04.5.3 (2021-10-03)Fix bug where setting a socket timeout would break the SSL handshake.Support for brotli and zstd content encoding.Suppress HTTP protocol warning.4.5.2 (2021-08-23)Fix bug where automatic decoding of response body would break page loading when using response interceptors.Fix bug where exclude_hosts had no effect when using undetected_chromedriver.v2.Fix occasional unpickle error when stored requests are asked for before they have been fully flushed to disk.4.5.1 (2021-08-20)Fix attribute error preventing undetected chromedriver from starting.4.5.0 (2021-08-19)Allow upstream proxy to be changed on the fly.4.4.1 (2021-08-10)Fix async bug that breaks Django ORM.4.4.0 (2021-07-23)Introduce in-memory request storage.Default request storage now uses system temp folder by default.Remove mitmproxy backend. Selenium Wire uses mitmproxy by default so a separate mitmproxy backend is redundant.4.3.3 (2021-07-19)Fix proxy authorization failures when Selenium Wire is run in multiple threads.4.3.2 (2021-07-11)Fix bug where the upstream no_proxy setting would be ignored for http hosts.Prevent Firefox from bypassing Selenium Wire for localhost addresses.Fix bug where DNS wasn’t being resolved through the proxy for socks5h.4.3.1 (2021-06-13)Don’t fold separate Set-Cookie response headers into a single header.Add additional SSL certificate properties to request.cert4.3.0 (2021-05-06)Allow selection of undetected_chromedriver version.Add new attribute request.host4.2.5 (2021-05-03)Switch to upstream_cert=True by default, enabling HTTP/2.4.2.4 (2021-04-13)Fix bug where disable_capture would break upstream proxy authentication.4.2.3 (2021-04-03)Fix bug where it was not possible to specify socks4 in proxy configuration.4.2.2 (2021-03-19)Fix concurrency issue in RequestStorage that allowed partially stored requests to be retrieved.4.2.1 (2021-03-09)Make SSL certificate metadata available via request.certSuppress connection aborted error by default.Log error on proxy authentication failure.4.2.0 (2021-03-03)Add support for HAR format.Add disable_capture option.Add driver.iter_requests().Fix bug where no_proxy was being ignored in proxy configuration.4.1.1 (2021-02-26)Integration with undetected-chromedriver.4.1.0 (2021-02-24)Implement websocket message capture.Fix bug where closure of event loop externally would trigger exception on shutdown.Fix bug preventing use of an empty password for an upstream proxy.4.0.5 (2021-02-15)Downgrade “The client may not trust Selenium Wire’s certificate” to debug.Introduce auto_config option.4.0.4 (2021-02-05)Fix bug where Selenium Wire would attempt to close running event loop.4.0.3 (2021-02-04)Fix bug where IPv6 addresses were not being enclosed in square brackets, breaking the local proxy URL.4.0.2 (2021-02-01)Fix additional problems caused by IPv6 socket binding.4.0.1 (2021-02-01)Fix bug where binding to IPv6 socket would prevent Selenium Wire from starting.4.0.0 (2021-01-31)Rework the default backend to:improve performance when connecting to upstream proxiesremove the need for starting an openssl subprocess for certificate generationfix issue where duplicate headers could not be proxied to the upstream serverfix issue where the response status code was being overridden by the CONNECT statuslay the groundwork for supporting websocket message capturelay the groundwork for supporting SSL pass-through3.0.6 (2021-01-30)Fix bug preventing mitmproxy backend from using custom confdir.3.0.5 (2021-01-18)Suppress upstream connection errors based on configuration.3.0.4 (2021-01-07)Revert change to capture OPTIONS requests by default.3.0.3 (2021-01-07)Decode response body on load.3.0.2 (2021-01-05)Fix issue where remote web driver client was being imported from incorrect package.3.0.1 (2021-01-03)Create a new event loop if current event loop is closed.3.0.0 (2021-01-02)Inroduce request and response interceptors.Run mitmproxy backend in a thread rather than subprocess.Drop internal HTTP admin API.Drop support for Python 3.4 and 3.5.Add support for remote webdriver client.Add support for duplicate request and response headers.Fixed issue where Proxy-Connection header was being propagated.Fixed issue where desired capabilities could not be reused outside of Selenium Wire due to addition of proxy config.Deprecation of header_overrides, param_overrides, querystring_overrides, rewrite_urls, custom_response_handler2.1.2 (2020-11-14)Prevent Chrome from bypassing Selenium Wire for localhost addresses.2.1.1 (2020-08-10)Automatic port number selection for mitmproxy backend.2.1.0 (2020-07-21)Support regular expressions in driver.wait_for_request().2.0.0 (2020-07-14)Introduce the mitmproxy backendSupport for modifying response headersSupport for modifying request parameters and the query stringBreaking API changes:the request.path attribute now returns the path rather than the full URL. To retrieve the URL, use request.url.empty request and response bodies are now returned as empty bytesb’’rather thanNone.1.2.3 (2020-06-19)Disable connection persistence by default due to side effects in certain cases.1.2.2 (2020-06-12)Close connection on error rather than send 502 response to permit browser retry.1.2.1 (2020-06-09)Use SHA256 digest when creating site certificates to fix Chrome HSTS security errors.1.2.0 (2020-06-07)Add properties to allow easy retrieval of the query string and request parameters.Don’t verify SSL by default.Allow configurable number of request threads.Use connection persistance (keep-alive) by default. Make configurable.1.1.2 (2020-05-27)Fix bug where request thread would spin after websocket closure.1.1.1 (2020-05-25)Handle errors occuring on websocket connections.1.1.0 (2020-05-23)Allow the request storage base directory to be configurable.Support proxying websocket connections.Fix bug where attempting to filter out non-existent headers would raise an error.Handle possibility of zero byte captured request/response files.1.0.12 (2020-05-16)Support for SOCKS proxies.1.0.11 (2019-12-31)Fix duplication of content-length header when altering body content.1.0.10 (2019-09-22)Scope request capture.Apply header filtering on a per-URL basis.1.0.9 (2019-08-25)Add ability to provide a custom response handler method.1.0.8 (2019-08-01)Remove signal handler from AdminClient to allow running in multi-threaded environment.Make connection timeout configurable.1.0.7 (2019-07-30)Fix bug where temporary storage cleanup would sometimes fail when running in a multi-threaded environment.Don’t rely on signal handlers for temporary storage cleanup. Signal handlers are not compatible with multiple threads. Use driver.quit() for explicit cleanup.1.0.6 (2019-07-14)Support for disabling SSL verification when using self-signed certificates.1.0.5 (2019-06-15)Improve performance on Windows by explicitly closing the response output stream.Capture stderr leaking from openssl to the console.Ensure subjectAltName is added to self signed certificates.Refactor certificate generation code.More robust handling of socket errors.Decode response bodies at the point a client asks for them, not at the point a response is captured.1.0.4 (2019-04-04)Clean up cached request directory tree on driver.quit().Suppress connection related errors by default.1.0.3 (2019-04-01)Responses are no longer sent chunk by chunk where they are missing a Content-Type header.Ensure delayed responses don’t cause errors when server is not explicitly shutdown.1.0.2 (2019-03-10)Support for authentication when using http based proxies.Fix bug where JSON response bodies were being decoded rather than being sent through as bytes.1.0.1 (2019-02-07)Support PATCH requests1.0.0 (2018-12-31)Ensure stored response body is always retrieved as bytes when asked for by the test.Updates to README.Use reverse chronological ordering of HISTORY.0.10.0 (2018-10-30)Fix issue where ignoring OPTIONS requests would trigger AttributeError.Allow proxy settings to be explicitly set to None.0.9.0 (2018-10-28)Ignore OPTIONS requests by default, and allow list of methods to be configurable via the ignore_http_methods option.Move default Selenium Wire request storage from system temp to user home to prevent permission collisions.0.8.0 (2018-09-20)Fix issue where new headers were not being added to the request when using driver.header_overrides.0.7.0 (2018-08-29)README and doc updates.0.6.0 (2018-08-21)Bundle openssl.cnf for Windows.0.5.0 (2018-08-19)Clearer README instructions.0.4.0 (2018-08-19)OpenSSL for Windows now bundled.Setup instructions for Edge.0.3.0 (2018-08-07)Fix remote proxy basic authentication.Updates to README.0.2.0 (2018-08-04)Load proxy settings from env variables.Support disabling of content encoding.Updates to README.0.1.0 (2018-06-19)First release on PyPI.