Senior Software Engineer

Openshift Platform Performance And Scale Engineer

The Red Hat Performance and Scale Organization is seeking a seasoned senior engineer to join our OpenShift Platform Performance and Scale Team. This role involves testing, measuring, and analyzing the performance and scalability of Red Hat OpenShift, the leading application modernization platform built on Kubernetes, to support the evolution of OpenShift Networking for serving a wide variety of customer use cases.

Red Hat OpenShift Networking is a foundational element of the platform, designed to support mission-critical workloads with both high throughput and low latency requirements. It encompasses a suite of features, plugins, and advanced networking capabilities that enhance Kubernetes networking, providing customers with the tools they need to manage traffic across single or multiple hybrid clusters effectively. This role will concentrate on performance and scalability testing of features and solutions aimed at ensuring that Red Hat OpenShift Networking meets customer needs at every stage of their journey, whether they're migrating legacy systems or modernizing applications. The engineer will leverage their knowledge of systems, networking and hardware performance to theorize bottlenecks and limitations, devise test plans, execute workloads, collect and analyze data, and communicate findings.

This role will require the ability to work cross-functionally with product management, engineering leadership, development teams, and quality engineers to measure performance, clearly articulate findings, and address bottlenecks. Time will also be spent collaborating with software engineering teams on bug fixes, code optimization, and resource usage reduction, as well as developing open-source tools for the reliability and repeatability of tests. This is a unique opportunity to work at the intersection of cutting-edge hardware and software!

The broader mission of the Performance and Scale organization is to establish performance and scale leadership across the Red Hat product and cloud services portfolio. The scope includes component-level, system, and solution analysis and targeted enhancements. The team collaborates with engineering, product management, product marketing, customer support, and Red Hat's hardware and software ecosystem partners.

At Red Hat, our commitment to open source innovation extends beyond our products - it's embedded in how we work and grow. Red Hatters embrace change especially in our fast-moving technological landscape and have a strong growth mindset. That's why we encourage our teams to proactively, thoughtfully, and ethically use AI to simplify their workflows, cut complexity, and boost efficiency. This empowers our associates to focus on higher-impact work, creating smart, more innovative solutions that solve our customers' most pressing challenges.

What you will do:

• Work closely with management, product owners, developers, and quality engineers to understand product requirements and build suitable test plans to verify the performance and scale of OpenShift Networking features and solutions that are based on the Mutlus, OVNKubernetes and OVN (Open Virtual Network) and OpenvSwitch projects.
• Develop sophisticated tests that simulate user workloads through comprehensive end-to-end automation, leveraging custom-built and state-of-the-art open-source tools and frameworks.
• Deep dive into performance issues with the intent of discovering their root causes in complex distributed systems.
• Design and develop monitoring and reporting tools for performance and scale tests and analysis.
• Document your research and results clearly and concisely, and communicate findings both internally and externally.
• Engage in upstream communities to help test performance and scale early and influence design and development decisions.
• Triage, debug, and root cause customer issues related to OpenShift performance and scale.
• Present your work and findings at internal and external conferences.

What you will bring:

• Master's Degree in Computer Science or a related field with 3+ years of relevant experience, or a Bachelor's Degree in Computer Science or a related field with 5+ years of relevant experience.
• Demonstrable experience, understanding, and passion for performance engineering.
• Working knowledge of Kubernetes or OpenShift.
• Strong programming, debugging, and profiling skills in Python and/or Golang.
• Hands-on experience with performance measurement, analysis, and optimization.
• Experience with distributed systems.
• Thorough understanding of the TCP/IP stack and experience with Software Defined Networking Technologies like OVN (Open Virtual Network) and OpenvSwitch or similar.
• Very strong Linux system administration and system engineering skills.
• Solid scripting skills, particularly with Bash, Python, or Ansible.
• Experience working with public clouds like AWS, Azure, GCP, or IBM Cloud, as well as bare metal environments.
• Experience analyzing and interpreting large volumes of test results and succinctly communicating findings through easy-to-understand graphs/charts.
• Experience with collaborative software development methodologies, tools, and version control.
• Knowledge of statistical analysis and experimental design techniques.
• Excellent communication and interpersonal skills.
• Ability to work independently and proactively seek collaboration.
• Collaborate with cross-functional teams to identify opportunities for AI integration within the software development lifecycle, driving continuous improvement and innovation in engineering practices; share use cases for successful experiments with stakeholders for broader use.

The following are considered a plus:

• Experience with container technologies like Podman or Docker, and familiarity with building container images.
• Experience with system performance engineering and metrics collection tools like iostat, vmstat, sar, perf, and Prometheus.
• Experience with monitoring and dashboarding tools like Prometheus and Grafana.
• Experience testing different network adapters and hardware offload technologies.
• A demonstrated history of contributing to open-source projects.
• Presentation skills and public speaking abilities for conferences and demonstrations.