Databricks Architect

Company Overview

Company details are not specified.

Job Summary

The Databricks Architect will play a crucial role in designing and implementing robust data platforms and data science solutions. This position requires extensive expertise in various technologies and the ability to articulate complex data-driven solutions to technical audiences. The architect will work closely with enterprise architects, cloud engineering teams, and security teams to ensure the solutions align with the organization’s strategic objectives.

Responsibilities

• Define and design a Data Platform Reference Architecture that supports reuse across divisional implementations.
• Establish Databricks Standards and analyze their usage in relation to the client's existing technology investments and strategies.
• Evaluate and uplift technology for Data Science, ensuring it meets current and future needs.
• Investigate and identify gaps or enhancements in the solution design for divisions in Data Science.
• Develop and enhance the Data Science Reference Architecture to facilitate reuse across divisional implementations.
• Collaborate closely with Group Enterprise Architects, Cloud Engineering Teams, and Security Architects to ensure deliverables meet quality standards and align with client aspirations.
• Engage with divisional team architecture, engineering, and security and privacy teams to solicit feedback while maintaining alignment with Group Data & AI Architecture viewpoints.
• Review architecture inputs with Databricks Subject Matter Experts (SMEs), incorporating feedback as necessary to ensure strategic alignment.
• Secure necessary approvals for architectural designs through various Architecture Forums at divisional and global levels.

Qualifications

• Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Over 15 years of experience in IT.
• At least 5 years of proven experience working with Azure Data Factory (ADF), Databricks, and Power BI/ThoughtSpot in an architectural and design capacity for Data Platforms and Data Science/Machine Learning.
• Strong understanding of design patterns, anti-patterns, security and privacy considerations related to Data Platforms and Data Science.
• Familiarity with the Insurance industry and its data needs.
• Excellent documentation skills, with a knack for presenting information in a comprehensive and consumable manner.
• Ability to communicate effectively with a range of stakeholders, from engineers to heads of departments.

Preferred Skills

• Experience in working with Machine Learning frameworks and tools.
• Familiarity with cloud-based data architectures and services.
• Knowledge of data governance and compliance standards.

Experience

• Minimum of 15 years in IT roles with significant experience in data architecture, data science, and machine learning solutions.

Environment

This position is located in Pune/Ahmedabad, with the potential for remote work depending on organizational policies. The role may require interaction across various locations.

Salary

Salary details have not been specified.

Growth Opportunities

Opportunities for career advancement within the company are not specified.

Benefits

Details regarding employee benefits are not specified.