Estuary October product updates roundup

It’s time to wrap up October, the spookiest of months. 🐈⬛ But you don’t have to be scared that you missed something: we collect all the most notable Estuary releases in this product round-up. High Performance Snowpipe Streaming We’ve upgraded our Snowflake materialization connector’s Snowpipe Streaming integration from Classic to the High Performance architecture. This allows us to make use of Snowflake’s improvements to real-time data ingestion as well as letting you benefit from Snowflake’s simplified cost structure for HP Snowpipe Streaming. Another benefit of the new architecture is an improved ability to scale. Tying into our recent runtime enhancements and materialization sharding, tasks using the High Performance Snowpipe Streaming integration will be able to expand throughput across multiple shards. To use it, you must: Provide the snowpipe_streaming_v2 flag as a feature flag under Advanced configuration Use key-pair authentication on the connector Set Delta Updates mode for bindings that should use Snowpipe Streaming Run your materialization on Estuary’s new runtime We’re migrating eligible tasks that use Snowpipe Streaming Classic over in a staggered rollout. In the meantime, you can try out High Performance yourself or learn more in the docs. Observability For Every Way You Work Estuary’s released new ways to view and track data movement. In the dashboard Connector details pages now include an expanded Collections view. This new section lists all of the capture or materialization’s associated collections, the amount of data in or out, and the last time data was seen. You can also search, filter, and sort your collections to quickly check on the status of a specific binding or find stalled streams. Read the product update for a rundown. In your data flows You can now read your Estuary account data directly into your data flows. The Estuary capture connector includes a dozen data streams covering catalog stats, alerts, invoices, and more account details. This lets you drop stats and account data into your existing data architecture, sending it to your warehouse or logs. Alongside Estuary’s other observability features like the OpenMetrics API and flowctl logs and stats, you can set up detailed pictures of your data movement, however you want to work with it. New Capture Connectors Besides the Estuary connector, October has seen a number of other capture connector releases: Linear: Incrementally sync product management updates into your workflow, like issues, projects, and initiatives. Okta: Stay up to date with your identity management system, syncing users, groups, applications, and system log data from Okta’s Management API. AWS Cost Explorer: Track your cloud costs with daily reports grouped by service or linked account. Aircall: A native rewrite of a third-party-based connector, this version includes all the same data streams with better performance with the Estuary platform and the ability to set an interval or sync schedule on each data stream. 🚧 Caution: Deprecation Zone 🚧 With the release of the native Aircall capture connector, the old third-party Aircall connector is now considered deprecated. HubSpot is retiring their V1 pipelines API on December 4. If you’re still using the legacy HubSpot capture connector, it’s a good time to migrate to the native HubSpot capture connector: the legacy connector will no longer support the deal_pipelines data stream while the native connector will be updated to use the latest recommended version of the API. Reach out if you have any questions about deprecations or trouble switching to new versions. Other Updates & Release Notes The PostHog capture connector supports a new incremental sessions stream. The dashboard received improvements around the onboarding flow to streamline signup for both completely new tenants and new users to existing tenants. SQL captures will report more granular backfill progress, with the percentage complete, num