Solution Architect Databricks Lakehouse Migration AI Modernization
Raritan NJ Onsite
We are seeking an experienced Solution Architect to lead the migration and modernization of enterprisescale data lakes from Azure Databricks to AWS Databricks while transforming the platform into an AIready Lakehouse architecture The role involves defining targetstate architecture migration strategy governance frameworks modernization roadmaps and AIGenAI enablement across largescale data ecosystems
The ideal candidate will have deep expertise in Databricks cloud migration modern data architecture and AIdriven data platforms with experience leading complex enterprise transformation programs involving thousands of data assets and multiple downstream applications
Key Responsibilities
Architecture Strategy
Define endtoend migration strategy from Azure Databricks to AWS Databricks
Design scalable Lakehouse architecture using Medallion principles Bronze Silver Gold
Develop Day1 Business Continuity and Day2 Modernization AI Enablement migration roadmaps
Perform application and dependency assessment across upstream and downstream systems
Establish architecture patterns standards and best practices for cloudnative data platforms
Migration Modernization
Lead migration of data pipelines notebooks Delta tables workflows and data products
Modernize legacy ETLELT frameworks using Databricks native capabilities
Optimize performance scalability security and operational efficiency
Define migration approach for CDC batch streaming and realtime workloads
Drive technology rationalization and tool consolidation initiatives
AIReady Data Platform
Build AIready data foundations leveraging Delta Lake and Unity Catalog
Design data architectures supporting ML GenAI RAG feature stores and advanced analytics
Enable governed data access for data scientists and AI applications
Define semantic models metadata strategies lineage and data discovery frameworks
Establish frameworks for AI governance and responsible AI adoption
Data Governance Security
Architect enterprisewide governance using Unity Catalog
Design data lineage auditing access controls masking and compliance standards
Implement data quality observability and monitoring frameworks
Ensure platform adherence to security and regulatory requirements
Stakeholder Management
Collaborate with business data engineering analytics AI security and cloud teams
Lead architecture review boards and executivelevel discussions
Mentor solution architects technical leads and engineering teams
Drive estimation roadmap planning risk assessment and governance reviews
Required Experience
12 years in Data Analytics
5 years as a Solution Architect or Lead Architect
Proven experience in largescale cloud migration programs
Handson experience with Azure Databricks and AWS Databricks
Experience migrating enterprise Data LakesLakehouses across cloud platforms
Strong understanding of Medallion Architecture and Delta Lake
Experience with Modern Data Platforms supporting AIML workloads
Expertise in enterprise integration and largescale data ecosystems
Technical Skills
Databricks Data Engineering
Databricks Workflows
Delta Lake
Delta Sharing
Unity Catalog
Delta Live Tables
Spark PySpark
Databricks SQL
Structured Streaming
Cloud Platforms
Azure Databricks
AWS Databricks
ADLS Gen2
Amazon S3
IAM
VPC
Glue
Lambda
Redshift good to have
Data Integration
Informatica PowerCenter IDMC
Azure Data Factory
Kafka
CDC Frameworks
API Integration
Eventdriven Architectures
AI Advanced Analytics
GenAI Architecture
RAG Frameworks
Vector Databases
Feature Stores
MLflow
Databricks AIML
Azure OpenAI Amazon Bedrock
DevOps Governance
CICD
Git
Terraform
Infrastructure as Code
Data Quality Frameworks
Data Observability
Security Compliance
Preferred Qualifications
Databricks Certified Professional
AWS Solution Architect Certification
Azure Solution Architect Certification
Experience in Life Sciences Supply Chain Manufacturing or Healthcare domains
Experience leading migration programs involving 1000 datasets and multiple business applications
Key Success Metrics
Successful migration with zero business disruption
Reduction in platform complexity and technical debt
Improved performance and cost optimization
Enterprise adoption of AIready data products
Increased governance lineage and compliance coverage
Accelerated delivery of analytics and GenAI use cases
This JD is tailored for the kind of Azure Databricks AWS Databricks modernization and AIready lakehouse transformation programs reflected in your recent DPSCDL migration initiatives"
Skills
Mandatory Skills : Databricks, Python, SparkSQL
Good to Have Skills : Delta Lake
Other details
Variable Compensation: This position includes a bonus or variable payout component based on individual and organizational performance. Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity.
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):
Benefits and Perks:
Comprehensive Medical Plan Covering Medical, Dental, Vision
Short Term and Long-Term Disability Coverage
401(k) Plan with Company match
Life Insurance
Vacation Time, Sick Leave, Paid Holidays
Paid Paternity and Maternity Leave
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law. Benefits
Compensation range: $110,000.00 to $160,000.00 per year
About LTM
LTM is an AI-centric global technology services company and the Business Creativity partner to the world’s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI — enabling new ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM — a Larsen & Toubro company — owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltm.com/careers/recruitment-fraud-alert
