Senior AI Data Engineer

About Scorpion

Scorpion is a leading provider of technology and services dedicated to helping local businesses thrive. We empower our clients by providing insights into local market dynamics, optimizing their marketing efforts, and enabling them to deliver exceptional customer experiences. Our comprehensive suite of tools offers a unique blend of AI support and human expertise, all committed to client success. We leverage SEO, Reviews, Advertising, Email Marketing, Chat and Messaging, Social Media, Website development, Lead Management, and Appointment Scheduling to help local businesses understand their unique business, market, and customer needs.

About the Role

The Senior Data Engineer will be a key member of Scorpion's AI team, responsible for building and enhancing the trusted data foundation that powers our AI products, tools, and decision-making processes. You will construct Scorpion's unified analytical data layer, serving as a single, reliable, and secure source of client and business data for AI agents, machine learning models, and internal teams.

You will collaborate closely with engineering, data science, product, and AI leaders to design scalable analytical systems, develop production-grade data pipelines from operational and third-party sources, and ensure data access is performant, consistent, and aligned with business objectives. Your contributions will directly impact how Scorpion utilizes data and AI to deliver value to both clients and employees.

Beyond daily engineering tasks, you will help shape Scorpion's long-term AI and data platform strategy, influencing how data is organized, governed, secured, and leveraged to support future products, insights, and AI-powered experiences. You will establish and maintain data quality standards, reliability expectations, and service-level agreements to ensure the availability of trusted, queryable data across the organization.

Key Responsibilities

• Evaluate and improve data quality, completeness, and consistency across more than 30 databases, applications, platforms, and APIs.
• Design and build Scorpion's analytical data platform, establishing a trusted source of truth for business and client data.
• Develop and maintain scalable data pipelines for efficient data movement from operational systems into the analytical platform.
• Assist teams in transitioning from direct querying of production databases to utilizing trusted analytical data sources.
• Design data access patterns that enable AI agents and applications to quickly retrieve relevant client and business information.
• Build secure, scalable solutions that deliver client context and business insights to internal applications and AI-powered experiences.
• Define, monitor, and improve service level agreements (SLAs) for data freshness, availability, reliability, and performance.
• Partner with engineering, product, and data science teams to establish data standards, governance practices, and data contracts.
• Continuously enhance the scalability, performance, and reliability of Scorpion's data ecosystem.

Requirements

• Education: Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
• Experience:
  • 7+ years of data engineering experience, including designing and operating production-scale analytical data platforms.
  • Proven experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments.
  • Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms.
  • Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions.
  • Experience designing scalable data models that support analytics, reporting, and AI-driven applications.
  • Experience establishing data governance standards, data contracts, and documentation practices across teams.
• Technical Skills:
  • Data Processing & Lakehouse Technologies: Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation.
  • Data Warehousing & Analytics: Experience with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
  • Programming & Query Languages: Advanced SQL skills (including optimization, execution planning, and performance tuning) and strong Python skills for data pipeline development, automation, transformation, and production system integration.
  • Data Pipeline & Orchestration Tools: Experience with dbt, Airflow, Prefect, or similar orchestration and transformation tools.
  • Architecture & Security: Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.
• Professional Skills:
  • Effective collaboration skills across engineering, product, data science, and business teams.
  • Strong communication skills with the ability to translate business requirements into scalable data solutions.
  • Strong analytical and problem-solving skills with a focus on building scalable, maintainable systems.
  • Ability to balance long-term platform strategy with near-term business priorities.

Our Values

• Winning Mindset: Client success is our success.
• Genuine Care: