Senior Director of Engineering, AI Workload Orchestration

at Oracle in Dover, Delaware, United States

Job Description

Job Description

Here at OCI we’re building the world’s largest AI clusters and we’re the fastest at bringing them to market. The AI Infrastructure organization at OCI is leading this effort.

As part of this focus on AI workloads and customers we’re building platforms for AI job management services and AI workload management, from reinforcement learning to deep learning to tuning and model serving. These platforms will give AI researchers simple, easy to use tools that take care of managing the GPU clusters they have across the full model lifecycle. These platforms will eliminate devops efforts and costs in cluster management, scheduling and observability and significantly lower the bar for infrastructure management expertise for our AI customers. It will make our AI capabilities easily accessible to more customers and will enable our largest customers to focus on improving and monetizing their AI models rather than managing the AI infrastructure.

In this role you would lead the software development organization building out and operating these platforms and work with some of the largest players in the AI space building systems that operate at unprecedented speed, scale and reliability. You should be a distributed systems generalist, able to architect broad systems interactions, while being very hands-on, able to dive deep into any part of the stack and lower-level system interactions. You should value simplicity and scale, work comfortably in a collaborative, agile environment, and be excited to learn.

Career Level – M5


The candidate will be responsible for providing leadership, direction and strategy, establishing and development of the organization to meet and execute on strategy. The candidate will also be working with geographically distributed teams and contribute to the success of theirs and of other related teams in delivering large scale projects on-time with the high quality

Required Qualifications

+ MS or BS in Computer Science, or equivalent experience

+ 5+ years of experience managing Software Engineering teams.

+ 12+ years of software engineering experience

+ Strong communication skills, analytical skills, and project management skills

Preferred Qualifications:

+ 7 – 10+ years’ experience delivering and operating large scale, highly available distributed systems.

+ Strong knowledge of data structures, algorithms, operating systems, and distributed systems fundamentals.

+ Working familiarity with networking protocols (TCP/IP, HTTP) and standard network architectures.

+ Strong experience and detailed technical knowledge in distributed systems, high performance computing and GPU systems.

+ Experience in AI model training infrastructure.


Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range: from $142,900 to $338,600 per annum. May be eligible for bonus, equity, and compensation deferral.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.

Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:

1. Medical, dental, and vision insurance, including expert medical opinion

2. Short term disability and long term disability

3. Life insurance and AD&D

4. Supplemental life insurance (Employee/Spouse/Child)

5. Health care and dependent care Flexible Spending Accounts

6. Pre-tax commuter and parking benefits

7. 401(k) Savings and Investment Plan with company match

8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.

9. 11 paid holidays

10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.

11. Paid parental leave

12. Adoption assistance

13. Employee Stock Purchase Plan

14. Financial planning and group legal

15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

About Us

As a world leader in cloud solutions, Oracle uses tomorrow’s technology to tackle today’s problems. True innovation starts with diverse perspectives and various abilities and backgrounds.

When everyone’s voice is heard, we’re inspired to go beyond what’s been done before. It’s why we’re committed to expanding our inclusive workforce that promotes diverse insights and perspectives.

We’ve partnered with industry-leaders in almost every sector-and continue to thrive after 40+ years of change by operating with integrity.

Oracle careers open the door to global opportunities where work-life balance flourishes. We offer a highly competitive suite of employee benefits designed on the principles of parity and consistency. We put our people first with flexible medical, life insurance and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by calling +1 888 404 2494, option one.


Oracle is an Equal Employment Opportunity Employer*. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

  • Which includes being a United States Affirmative Action Employer**
Copy Link

Job Posting: JC260593751

Posted On: May 31, 2024

Updated On: Jun 27, 2024

Please Wait ...