Data Architect Databricks Job at Atem Corp, Santa Clara, CA

Y244TEpMVDNnUkdLUGRBTGQxZ0NwNWNtWlE9PQ==
  • Atem Corp
  • Santa Clara, CA

Job Description

About the Role

We're seeking a visionary Data Architect with deep expertise in Databricks to lead the design, implementation, and optimization of our enterprise data architecture. You'll be instrumental in shaping scalable data solutions that empower analytics, AI, and business intelligence across the organization.

If you thrive in a fast-paced environment, love solving complex data challenges, and have a passion for cloud-native platforms like AWS Databricks , we want to hear from you.

Key Responsibilities

  • Design and implement robust, scalable, and secure data architectures using Databricks , Spark, Delta Lake, and cloud-native tools.
  • Collaborate with data engineers, analysts, and business stakeholders to define data models, pipelines, and governance strategies.
  • Develop and maintain data lakehouses, ensuring optimal performance and cost-efficiency.
  • Define best practices for data ingestion, transformation, and storage using Databricks notebooks, jobs, and workflows.
  • Architect solutions for real-time and batch data processing.
  • Ensure data quality, lineage, and compliance with internal and external standards.
  • Lead migration efforts from legacy systems to modern cloud-based data platforms.
  • Mentor junior team members and evangelize data architecture principles across the organization.

Required Skills & Qualifications

  • 12+ years of experience in data architecture, with 5+ years hands-on in Databricks.
  • Strong Experience in Snowflake
  • Experience in cloud platforms AWS, especially AWS Databricks.
  • Strong proficiency in Apache Spark, Delta Lake, and PySpark.
  • Experience with data modeling, ETL/ELT pipelines, and data warehousing.
  • Familiarity with CI/CD, DevOps, and Infrastructure as Code (Terraform, ARM templates).
  • Knowledge of data governance, security, and compliance frameworks.
  • Excellent communication and stakeholder management skills.

Preferred Qualifications

  • Databricks Certified Data Engineer or Architect.
  • Experience with MLflow, Unity Catalog, and Lakehouse architecture.
  • Background in machine learning, AI, or advanced analytics.
Experience with tools like Apache Airflow, dbt, or Power BI/Tableau.

Job Tags

Similar Jobs

Dogtopia of Cranberry

Dog Daycare Attendant Canine Coach Job at Dogtopia of Cranberry

 ...Dog Daycare Attendant, Canine Coach No experience needed but this position is specifically for our large dog play room. Applicants must be able to work some evenings and some weekends. Applicants must be comfortable working around large dogs . We also require... 

Planet Fitness

Assistant Manager Job at Planet Fitness

Job SummaryThe Assistant Manager will be responsible forassisting in the oversight of gym operations to ensure an exceptional Judgement Free member experience as well as a financially successful club.Essential Duties and Responsibilities~Assist in recruiting, hiring... 

Stellar Professionals

PMP Certified Project manager Job at Stellar Professionals

 ...~ IT Audit ~ Project Quality Assurance ~ Application Implementation/development ~ PMP Certification ~ OCM Certified ~ Judicial System experience... 

JPMorgan Chase & Co.

Relationship Executive, Mid Corporate Banking- Managing Director Job at JPMorgan Chase & Co.

 ...strategic financial advice to businesses, a role as a Commercial Banker might be perfect for you. As a Commercial Banker in Mid-Corporate Banking,your primary responsibility will be new client acquisition and maintaining and deepening a portfolio of relationships. You... 

Certified Mobile Notary Service

Remote Notary Public Job at Certified Mobile Notary Service

 ...all documents/affidavits/pleadings have been executed and notarized properly based on state guidelines. - Maintain an electronic notary journal of all official acts. - Administer oaths during telephonic hearings or trials as required. - Maintain knowledge of current...