Senior Data Engineer (#375)

1. Technical Development (80%)

• Design and implement scalable, production-grade data platform infrastructure components using AWS, Databricks, and modern data stack architecture.
• Lead the development of critical data pipeline components, ensuring performance, security, reliability, and segregation of duty compliance.
• Architect and implement complex data transformation workflows to efficiently handle large-scale data processing.
• Develop and maintain infrastructure-as-code (IaC) for reproducibility and standardization.
• Implement advanced monitoring and observability solutions for the entire data platform.

2. Research & Innovation (10%)

• Research emerging technologies and architectural patterns to improve performance, maintainability, efficiency, and cost.
• Evaluate and prototype new tools and frameworks to enhance platform capabilities.
• Present technical proposals and Proof of Concepts (PoCs) to Data Platform Engineering leadership.
• Develop technical documentation and design proposals to support onboarding and platform improvements.

3. Technical Leadership (10%)

• Mentor and guide team members while reviewing critical code contributions.
• Collaborate with junior stakeholders to align technical solutions with business requirements.
• Lead technical design discussions and architecture review sessions.
• Share knowledge through documentation, workshops, and technical presentations.

Qualifications

1. Technical & Professional Skills

• Master's degree in Computer Science, Data Engineering, or related field.
• 10+ years of experience in data engineering and software development.
• Deep expertise in Cloud Platforms (AWS preferred) and data processing frameworks (Spark preferred).
• Expert-level proficiency in Python (preferred), Scala, or Java.
• Experience with modern SQL Warehouses (Databricks preferred, Snowflake, BigQuery) and data architectures (Lakehouse preferred).
• Strong experience in DBT (Data Build Tool) and Data Modeling methodologies.
• Expert-level knowledge of Infrastructure-as-Code (IaC) practices, using Terraform and AWS CDK.
• Solid background in distributed systems and high-performance computing.
• Proven ability to lead complex technical initiatives.

2. Behavioral Skills

• Strong communication skills to explain complex technical concepts to various audiences.
• Excellent problem-solving abilities and analytical thinking.
• Demonstrated leadership in technical decision-making.
• Self-motivated, with the ability to work autonomously.
• Experienced in mentoring and coaching technical team members.
• Strong project management skills with a results-oriented mindset.

3. Language Skills

• English: Business level.
• Japanese: Intermediate level (N2 or equivalent).