Data Architect (Azure Databricks) Job at VDart Inc, Plano, TX

YTdKZ0xKOU9Ec1BKbVBidUY1RjlkV2wzREE9PQ==
  • VDart Inc
  • Plano, TX

Job Description

Job Title: Data Architect (Azure Databricks)

Location: Plano, TX

Duration: / Term: Fulltime

Job Description:

Experience Desired: 12+ Years.

Key required skills

  • Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders.
  • Follow the Agile development methodology; think strategically and execute methodically.
  • Develop and manage capacity and growth projection forecasts of the environment within budgets.
  • Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.
  • Drive optimization, testing and tooling to improve quality of solutions.
  • Manage teams that build and operate high volume distributed systems in a SaaS environment.
  • Great at devising efficient processes that increase velocity and quality.

Desired Experience/ Skills:

  • 8+ years of relevant experience
  • At least 5 years of experience building and leading highly complex technical engineering teams.
  • Strong hands-on experience in Databricks
  • Experience managing distributed teams preferred.
  • Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills: financial/budget management, scheduling and resource management experience with medium and large-scale projects
  • Comfortable working with ambiguity and multiple stakeholders.
  • Experience in medallion architecture, optimization, Ingestion, Quality.
  • Should have worked on Unity Catalog and understands its architecture and how to leverage its Data Governance and Observability capabilities.
  • Comfortable working cross functionality with product management and directly with customers; ability to deeply understand product and customer personas.
  • Architecture Design Experience for Cloud and Non-cloud platforms
  • Expertise on Azure Cloud platform
  • Knowledge on orchestrating workloads on cloud
  • Ability to set and lead the technical vision while balancing business drivers
  • Strong experience with PySpark, Python programming
  • Proficiency with APIs, containerization and orchestration is a plus



Key Skills:

Data Architecture, Azure, Databricks, Python, PySpark, SQL

Job Tags

Full time,

Similar Jobs

Rice University

Human Resource Generalist Job at Rice University

 ...as a hybrid role with up to two remote days per week after initial Rice policy 440 work arrangements may be subject to change. Hiring Range: $60000 $70000. Compensation will be commensurate with experience and qualifications. *Exempt (salaried) positions under FLSA... 

The Pet Parlor, Ltd

Pet Sitter / Dog Walker Job at The Pet Parlor, Ltd

 ...Looking for a pet sitter/dog walker to add to our ever-growing 10 employee team who is interested in making up to $1000 a month loving on pets. Our Porter County staff covers our Porter county clients, and our Lake County staff covers Lake County clients. For every... 

Dronedeploy

Recruiter Job at Dronedeploy

 ...and scale. Were seeking a driven, strategic, and resourceful Recruiter who thrives in a SaaS environment and can deliver results. This...  ...executives and hiring managers. Availability for occasional travel for meetings, conferences, company events (~1x per quarter).... 

CareCore Health LLC

Licensed Nursing Home Administrator Job at CareCore Health LLC

Are you a compassionate leader committed to excellence in senior care? We are seeking an experienced Licensed Nursing Home Administrator to oversee the daily operations of a high-performing skilled nursing and rehabilitation facility located in Cincinnati, Ohio .... 

Sanborn Map Company

GIS Analyst Job at Sanborn Map Company

 ...departments and need to communicate effectively with them about our wide range of products and services. We remain at the forefront of the GIS and photogrammetry industry by offering high quality, technologically superior products and services backed by the industrys most...