In a bid to enhance its data processing and real-time sales lead generation, Carsales, a prominent player in the automotive marketplace, has undertaken a significant data transformation project.
Previously, the company had been grappling with fragmented data systems, a result of multiple tech teams working independently across different sections of the business. This fragmentation led to increased complexities, data processing challenges, and substantial time spent on maintenance and troubleshooting.
To address these issues, Carsales embarked on a quest to find a solution that would unify its data processes and enable quicker data delivery. After careful evaluation and proof-of-concept work, the company decided to partner with Snowflake for its data platform needs.
The data transformation involved the consolidation of various data sources, including databases, RabbitMQ, and web analytics, into a central S3 bucket. This central hub feeds Snowflake, which, in turn, seamlessly connects with Salesforce Marketing Cloud, Tableau, and a newly implemented self-service business intelligence and analytics capability powered by ThoughtSpot.
Enabled efficient anomaly detection for system faults
One of the driving factors for this transformation was the need to keep up with the real-time data requirements of Carsales’ partners. The previous batch pipeline, with updates occurring every four to six hours, couldn’t meet these demands. With Snowflake in place, the data latency has been dramatically reduced to an impressive median of just six minutes.
This near-real-time pipeline also brought another significant benefit: rapid fault detection. Carsales’ data teams, aware of the intricate nature of data streams and tasks, constructed an automated anomaly detection system aptly named “Anoma Lee.” This system monitors both tasks and data streams and promptly sends notifications via SMS and pager messages if any thresholds are breached.
With the implementation of Snowflake and the streamlined data processes, Carsales has not only improved partner integrations but also enabled efficient anomaly detection for system faults. This transformation marks a significant step toward unifying data processes, enhancing data-driven decision-making, and maintaining data integrity within the company.
As Carsales continues to drive innovation in the automotive marketplace, its adoption of Snowflake showcases its commitment to leveraging cutting-edge technology to stay at the forefront of the industry.
