2026-03-23 00:00:06 [scrapy.utils.log] INFO: Scrapy 2.14.2 started (bot: grabbers)
2026-03-23 00:00:06 [scrapy.utils.log] INFO: Versions:
{'lxml': '6.0.2',
 'libxml2': '2.14.6',
 'cssselect': '1.4.0',
 'parsel': '1.11.0',
 'w3lib': '2.4.0',
 'Twisted': '25.5.0',
 'Python': '3.14.3 (main, Feb  4 2026, 14:18:08) [GCC 11.4.0]',
 'pyOpenSSL': '26.0.0 (OpenSSL 3.5.5 27 Jan 2026)',
 'cryptography': '46.0.5',
 'Platform': 'Linux-6.12.68-92.122.amzn2023.x86_64-x86_64-with-glibc2.35'}
2026-03-23 00:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-23 00:00:07 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.logcount.LogCount',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'grabbers.extensions.custom_fields.ExportCustomFieldsExtension',
 'grabbers.extensions.kol_roles.ExportKolRolesExtension']
2026-03-23 00:00:07 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'grabbers',
 'FEED_EXPORT_FIELDS': ['External Id',
                        'Parent External Id',
                        'Name',
                        'Plain text: Parent Name',
                        'Start date',
                        'Start time',
                        'End date',
                        'End time',
                        'Location',
                        'Plain text: Event Link',
                        'Plain text: Event Link (Excel)',
                        'Plain text: Moderator(s)',
                        'Plain text: Presenter(s)',
                        'Plain text: Panelist(s)',
                        'Plain text: Speaker(s)',
                        'Plain text: Faculty',
                        'Plain text: Abstract Presenter(s)',
                        'Plain text: Poster Presenter(s)',
                        'Plain text: Chair(s)',
                        'Filter: Session Category',
                        'Plain text: Session Number',
                        'Plain text: Learning Objectives'],
 'LOG_FILE': '/etc/scrapyd/dbs/logs/grabbers/CCC '
             '2026/3c986840264b11f192122eb16fea6523.log',
 'LOG_LEVEL': 'INFO',
 'NEWSPIDER_MODULE': 'grabbers.spiders',
 'SPIDER_MODULES': ['grabbers.spiders'],
 'TELNETCONSOLE_ENABLED': False,
 'USER_AGENT': 'Mozilla/5.0 (X11; Linux x86_64; rv:131.0) Gecko/20100101 '
               'Firefox/131.0'}
2026-03-23 00:00:07 [scrapy_fake_useragent.middleware] INFO: Using '<class 'scrapy_fake_useragent.providers.FakeUserAgentProvider'>' as the User-Agent provider
2026-03-23 00:00:07 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'grabbers.middlewares.RandomUserAgentMiddleware',
 'grabbers.middlewares.RetryUserAgentMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-23 00:00:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
 'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'grabbers.middlewares.SilentValidationMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-03-23 00:00:07 [py.warnings] WARNING: /layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/scrapy/core/spidermw.py:143: ScrapyDeprecationWarning: SilentValidationMiddleware.process_spider_exception() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
  self._check_mw_method_spider_arg(process_spider_exception)

2026-03-23 00:00:08 [scrapy.middleware] INFO: Enabled item pipelines:
['grabbers.pipelines.CleanTextPipeline',
 'grabbers.pipelines.DateTimeFormatPipeline',
 'grabbers.pipelines.BoolFormatPipeline',
 'grabbers.pipelines.ValidateEventNamePipeline',
 'grabbers.pipelines.CountryCodePipeline',
 'grabbers.pipelines.HyperlinkedEventLinkPipeline',
 'grabbers.pipelines.ElasticSearchPipeline']
2026-03-23 00:00:08 [scrapy.core.engine] INFO: Spider opened
2026-03-23 00:00:08 [elastic_transport.transport] INFO: HEAD https://elasticsearch-es-http.elasticsearch.svc:9200/congress-events [status:200 duration:0.116s]
2026-03-23 00:00:08 [CCC 2026] INFO: Start reindexing existing events to historical index.
2026-03-23 00:00:08 [elastic_transport.transport] INFO: PUT https://elasticsearch-es-http.elasticsearch.svc:9200/congress-events/_settings [status:200 duration:0.041s]
2026-03-23 00:00:08 [elastic_transport.transport] INFO: DELETE https://elasticsearch-es-http.elasticsearch.svc:9200/congress-events-historical?ignore_unavailable=true [status:200 duration:0.042s]
2026-03-23 00:00:08 [elastic_transport.transport] INFO: PUT https://elasticsearch-es-http.elasticsearch.svc:9200/congress-events/_clone/congress-events-historical [status:200 duration:0.279s]
2026-03-23 00:00:08 [elastic_transport.transport] INFO: PUT https://elasticsearch-es-http.elasticsearch.svc:9200/congress-events/_settings [status:200 duration:0.036s]
2026-03-23 00:00:08 [elastic_transport.transport] INFO: PUT https://elasticsearch-es-http.elasticsearch.svc:9200/congress-events-historical/_settings [status:200 duration:0.037s]
2026-03-23 00:00:18 [elastic_transport.transport] INFO: POST https://elasticsearch-es-http.elasticsearch.svc:9200/_reindex?wait_for_completion=true [status:N/A duration:10.007s]
2026-03-23 00:00:18 [elastic_transport.node_pool] WARNING: Node <Urllib3HttpNode(https://elasticsearch-es-http.elasticsearch.svc:9200)> has failed for 1 times in a row, putting on 1 second timeout
2026-03-23 00:00:18 [CCC 2026] ERROR: ElasticSearch client initialization failed. Make sure ElasticSearch is running and connection settings are correct.
Traceback (most recent call last):
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/urllib3/connectionpool.py", line 534, in _make_request
    response = conn.getresponse()
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/urllib3/connection.py", line 571, in getresponse
    httplib_response = super().getresponse()
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/sentry_sdk/integrations/stdlib.py", line 146, in getresponse
    rv = real_getresponse(self, *args, **kwargs)
  File "/layers/paketo-buildpacks_cpython/cpython/lib/python3.14/http/client.py", line 1450, in getresponse
    response.begin()
    ~~~~~~~~~~~~~~^^
  File "/layers/paketo-buildpacks_cpython/cpython/lib/python3.14/http/client.py", line 336, in begin
    version, status, reason = self._read_status()
                              ~~~~~~~~~~~~~~~~~^^
  File "/layers/paketo-buildpacks_cpython/cpython/lib/python3.14/http/client.py", line 297, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
               ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^
  File "/layers/paketo-buildpacks_cpython/cpython/lib/python3.14/socket.py", line 725, in readinto
    return self._sock.recv_into(b)
           ~~~~~~~~~~~~~~~~~~~~^^^
  File "/layers/paketo-buildpacks_cpython/cpython/lib/python3.14/ssl.py", line 1304, in recv_into
    return self.read(nbytes, buffer)
           ~~~~~~~~~^^^^^^^^^^^^^^^^
  File "/layers/paketo-buildpacks_cpython/cpython/lib/python3.14/ssl.py", line 1138, in read
    return self._sslobj.read(len, buffer)
           ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
TimeoutError: The read operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/elastic_transport/_node/_http_urllib3.py", line 167, in perform_request
    response = self.pool.urlopen(
        method,
    ...<4 lines>...
        **kw,  # type: ignore[arg-type]
    )
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/urllib3/connectionpool.py", line 841, in urlopen
    retries = retries.increment(
        method, url, error=new_e, _pool=self, _stacktrace=sys.exc_info()[2]
    )
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/urllib3/util/retry.py", line 465, in increment
    raise reraise(type(error), error, _stacktrace)
          ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/urllib3/util/util.py", line 39, in reraise
    raise value
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/urllib3/connectionpool.py", line 787, in urlopen
    response = self._make_request(
        conn,
    ...<10 lines>...
        **response_kw,
    )
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/urllib3/connectionpool.py", line 536, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/urllib3/connectionpool.py", line 367, in _raise_timeout
    raise ReadTimeoutError(
        self, url, f"Read timed out. (read timeout={timeout_value})"
    ) from err
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='elasticsearch-es-http.elasticsearch.svc', port=9200): Read timed out. (read timeout=9.999626215081662)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/workspace/source/app/grabbers/pipelines/store_to_elasticsearch.py", line 72, in open_spider
    self._prepare_es_indexes()
    ~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/workspace/source/app/grabbers/pipelines/store_to_elasticsearch.py", line 95, in _prepare_es_indexes
    self.client.reindex_event_document(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        actual_index_name=self.index_name,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        historical_index_name=self.historical_index_name,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/workspace/source/app/grabbers/elasticsearch_client.py", line 145, in reindex_event_document
    self.client.reindex(
    ~~~~~~~~~~~~~~~~~~~^
        source={"index": actual_index_name},
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        dest={"index": historical_index_name},
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        wait_for_completion=True,
        ^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/elasticsearch/_sync/client/utils.py", line 421, in wrapped
    return api(*args, **kwargs)
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/elasticsearch/_sync/client/__init__.py", line 4027, in reindex
    return self.perform_request(  # type: ignore[return-value]
           ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        "POST",
        ^^^^^^^
    ...<5 lines>...
        path_parts=__path_parts,
        ^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/elasticsearch/_sync/client/_base.py", line 271, in perform_request
    response = self._perform_request(
        method,
    ...<4 lines>...
        otel_span=otel_span,
    )
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/elasticsearch/_sync/client/_base.py", line 315, in _perform_request
    meta, resp_body = self.transport.perform_request(
                      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        method,
        ^^^^^^^
    ...<8 lines>...
        otel_span=otel_span,
        ^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/elastic_transport/_transport.py", line 344, in perform_request
    resp = node.perform_request(
        method,
    ...<3 lines>...
        request_timeout=request_timeout,
    )
  File "/layers/paketo-buildpacks_pip-install/packages/lib/python3.14/site-packages/elastic_transport/_node/_http_urllib3.py", line 202, in perform_request
    raise err from e
elastic_transport.ConnectionTimeout: Connection timed out
2026-03-23 00:00:18 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-23 00:00:20 [scrapy_fake_useragent.middleware] INFO: Using '<class 'scrapy_fake_useragent.providers.FakeUserAgentProvider'>' as the User-Agent provider
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670197&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670087&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670083&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670026&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670024&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670025&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?Mode=sessioninfo&PresentationID=1669953>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670028&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670030&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670038&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670036&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670035&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1669999&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670000&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670032&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670033&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670004&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:32 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670003&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670007&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670008&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670005&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1669955&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1669959&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1669956&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670010&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1669957&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1669815&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670200&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670198&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670089&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670199&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670039&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670041&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670091&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670043&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670202&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670046&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670048&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670047&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670044&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670203&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670011&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670013&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670018&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670015&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670019&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670201&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670017&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670020&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670204&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1669962&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1738010&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1738011&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670022&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670021&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1669963&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1738009&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670095&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670093&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1750925&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670100&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670096&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670097&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670099&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1741910&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1670102&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1750928&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <403 https://crohnscolitiscongress2026.eventscribe.net/fsPopup.asp?PresentationID=1741909&mode=presInfo>: HTTP status code is not handled or not allowed
2026-03-23 00:00:33 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-23 00:00:33 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 254283,
 'downloader/request_count': 419,
 'downloader/request_method_count/GET': 419,
 'downloader/response_bytes': 5115175,
 'downloader/response_count': 419,
 'downloader/response_status_count/200': 331,
 'downloader/response_status_count/302': 20,
 'downloader/response_status_count/403': 68,
 'elapsed_time_seconds': 14.448977,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 23, 0, 0, 33, 432729, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 12152108,
 'httpcompression/response_count': 399,
 'httperror/response_ignored_count': 68,
 'httperror/response_ignored_status_count/403': 68,
 'item_scraped_count': 330,
 'items_per_minute': 1414.2857142857142,
 'log_count/INFO': 71,
 'memusage/max': 216977408,
 'memusage/startup': 216977408,
 'request_depth_max': 1,
 'response_received_count': 399,
 'responses_per_minute': 1710.0,
 'scheduler/dequeued': 419,
 'scheduler/dequeued/memory': 419,
 'scheduler/enqueued': 419,
 'scheduler/enqueued/memory': 419,
 'start_time': datetime.datetime(2026, 3, 23, 0, 0, 18, 983752, tzinfo=datetime.timezone.utc)}
2026-03-23 00:00:33 [scrapy.core.engine] INFO: Spider closed (finished)