AI/Data Infrastructure Backend Engineer
Job Summary
As a backend engineer in the data team, you will lead the development and operation of data infrastructure for AI products. You will design data pipelines, develop APIs, and incorporate AI functions while maintaining data quality. The role requires strong Python skills and experience with cloud platforms and container technologies.
Responsibilities
- Develop and operate AI data infrastructure
- Design and manage data pipelines
- Develop backend APIs and AI-integrated functions
- Ensure data quality and processing efficiency
Required Skills
- Python backend development
- Cloud (AWS/GCP/Azure) & Containerization
- Database (RDBMS/NoSQL) architecture
- LLM/GenAI conceptual knowledge
- Japanese fluency
Job Details
### Expected Role
As a backend engineer in the data team, you will lead the preparation and development of the data infrastructure required for our AI product. Leveraging your AI knowledge, you will design and develop systems that enable AI to efficiently utilize data, and, as needed, also be responsible for developing AI-powered features.
### Job Description
- Development and operation of data infrastructure for AI.
- Design, development, and operation of data pipelines for collecting, processing, and storing data necessary for AI model training and inference.
- Development and operation of APIs for providing data in an AI-friendly format.
- Building and operation of mechanisms for maintaining and improving data quality.
- Design, development, and operation of backend systems.
- Application development using Python (API development, batch processing development, etc.).
- Design and development of backend systems incorporating AI functions.
- Development of common functions and libraries usable across products.
- Development of subsystems for individual products as needed.
- Research, verification, and introduction of the latest AI technologies such as LLM/GenAI.
- Data preparation and preprocessing for improving AI model performance.
- Collaboration with other members of the data team and improvement of development process automation.
### Required Qualifications
- A doctoral or master's degree in Computer Science, Software Engineering, Artificial Intelligence, Machine Learning, Mathematics, Physics, or a related field.
- Experience developing backend applications using Python.
- Experience using cloud platforms (AWS, GCP, or Azure) and container technologies (Docker, Kubernetes).
- Experience designing and operating databases (RDBMS, NoSQL, etc.).
- Experience designing and developing APIs.
- Fundamental knowledge of computer science, including algorithms and data structures.
- Basic knowledge of LLM/GenAI and experience using it personally or professionally.
- Japanese (Fluent): Ability to discuss product development without misunderstandings.
### Preferred Qualifications
- Database management, design, and tuning skills.
- Experience building and operating data pipelines.
- Experience developing AI/ML-related products and processing large-scale data (Spark, Hadoop).
- Data warehouse (DWH) experience.
- Experience managing/creating training data for AI models.
- Front-end development experience using TypeScript/React/Next.js.
- Experience working in multinational teams.