Databricks AI Engineer

Overview

Administers, maintains, develops and implements policies and procedures for ensuring the security and integrity of the company databases. Implements data models and database designs, data access and table maintenance; resolves database performance issues, database capacity issues, replication, and other distributed data issues.

Job Description

ESSENTIAL DUTIES AND RESPONSIBILITIES

• Programming & Query Languages: Proficient in Python, and SQL for data analysis, modeling, and database management.
• Machine Learning & AI Models: Experience with classical ML (e.g., regression, decision trees, SVM), deep learning (CNNs, RNNs, Transformers), and advanced AI (GNNs, RL, GANs, LLMs like GPT-4, Claude, LLaMA).
• Natural Language & Vision AI: Skilled in NLP (NER, sentiment analysis, summarization) and computer vision (YOLO, ResNet, segmentation, OCR).
• Frameworks & Libraries: Hands-on with TensorFlow, PyTorch, Scikit-learn, Keras, Hugging Face Transformers, and Spark MLlib.
• Databricks Ecosystem: Proficient in Databricks Notebooks, MLflow, AutoML, Delta Lake, Unity Catalog, Feature Store, Model Serving, and Lakehouse AI.
• Data Engineering & Big Data: Experience with Apache Spark, Hadoop, Kafka, Airflow, dbt, and building scalable ETL pipelines.
• Cloud Platforms: Deploy and manage solutions on AWS (S3, SageMaker), Azure (ML, Synapse), and GCP (BigQuery, Vertex AI).
• Statistical Analysis & Experimentation: Apply A/B testing, hypothesis testing, Bayesian methods, and time series forecasting (ARIMA, Prophet, LSTM).
• Model Deployment & DevOps: Deploy models using Flask, FastAPI, Docker, Kubernetes, CI/CD pipelines, and integrate with APIs and Git for version control.
  
  
  

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

EDUCATION AND/OR EXPERIENCE Bachelor’s Degree (B. A.) from four-year college or university.

In-depth understanding of all aspects of database technology with minimum five years experience in database administration or equivalent job experience.

Experience with UNIX, Linux, and Microsoft Windows operating systems.

LANGUAGE AND COMMUNICATION SKILLS Ability to read, write, follow directions, and possess above average listening skills. Strong interpersonal skills and a sensitivity to understand customer needs. Excellent written and oral communications skills are essential. The ability to prepare written materials in a clear and concise format and in proper English is required

MATHEMATICAL SKILLS This position requires the ability to calculate figures and amounts such as discounts, interest, commissions, proportions, percentages, area, circumference, and volume as well as the ability to apply concepts of basic algebra and geometry.

REASONING ABILITY This job requires the ability solve practical problems and deal with a variety of concrete variables in situations where only limited standardization exists and the ability to interpret a variety of instructions furnished in written, oral, diagram or schedule form.

PHYSICAL DEMANDS The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

While performing the duties of this job, the employee is regularly required to talk or hear. The employee frequently is required to stand and walk. The employee is occasionally required to sit and reach with hands and arms. The employee is required to sit at a desk and work on a computer for long periods of time.

WORK ENVIRONMENT The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

While performing the duties of this job, the employee is occasionally exposed to moving mechanical parts and high precarious places. Occasionally handles emergency or crisis situations; frequently subject to interruptions, and multiple calls and inquiries. The noise level in the work environment is usually moderate.

OneMagnify is an equal opportunity employer.