- SLA (Service Level Agreement): The formal agreement between a service provider and a client regarding the expected level of service. - SLO (Service Level Objective): A subset of the SLA that specifies the measurable goals like uptime or response time. - SLI (Service Level Indicator): Metrics that measure system performance (e.g., availability, latency).

I have used relational databases like PostgreSQL and MySQL, as well as NoSQL databases like MongoDB and Cassandra. To manage query times, I use indexing, query optimization, caching (e.g., Redis), partitioning, connection pooling, and monitoring slow queries with tools like EXPLAIN and performance dashboards.

An ideal DevOps team performs continuous integration and continuous delivery, automates infrastructure and deployments, monitors system health, responds to incidents, collaborates with development and operations, manages configuration, ensures security compliance, and fosters a culture of shared ownership and blameless postmortems.

Answer: With the help of the following steps, I will keep my docker containers safe: It is a discipline that combines software engineering and system administration to ensure that those systems can scale and can be relied upon. Development of efficient operational processes, monitoring the performance of systems, and proactively fixing issues are focused on by site reliability engineers. One way they establish a potential trade-off between the speed of development and stability of the system is with SLIs, SLOs, and error budgets. Multithreading offers several advantages, especially in improving the performance and efficiency of applications: I have hands-on experience with several SRE tools. Here are a few examples: It can be an SLO to succeed in getting 99.9% uptime or even 95% successful API responses. Specific goals can make the slant of teams around a major aspect of performance. Paying every effort to achieve SLOs can ensure that the users find a service well meets their expectations, without having to compromise operational efficiency. APR usually stands for 'Annual Percentage Rate,' but in the context of SRE or tech, it might have a different meaning depending on the context. Such as, if the APR you refer to relates to something like Application Performance Reporting, I can describe tools and methods I've used for generating and interpreting performance reports across applications. Otherwise, I'm happy to elaborate further. Toil is defined as repetitive, manual, operant repeated tasks that are of no worth toward improving a system in the long run. Like, if the reboot of servers or manual deployments are performed repeatedly. SREs tend to minimize toil with automation, concentrating more of their time on high-impact activities that maximize system performance and reliability, and lastly overall efficiency improvement. Incident management starts with rapid detection and response to minimize downtime. SREs use monitoring tools to identify problems on the way to resolution, keeping the stakeholders informed of the status. Thereafter comes a post-incident and root cause analysis that entails improved strategies for future avoidance along with enhancements in the system. Monitoring and observability are key aspects in allowing any SRE to get a picture of a system's health. Monitoring alerts to a problem, while observability gives further insight into how well the system is performing, allowing the problem to be addressed before it takes place. Together, they act as a monitoring camp through which SRE can maintain a reliable system by preemptively tracing failures before they get to the end users or business processes. Proactive monitoring is the setup of alert thresholds ahead of an event which might be defined as pre-emptive monitoring, predictive tendency analysis at the system level is a particular example. Reactive monitoring waits until an event occurs to take action concerning that event-providing means to speed up the process of finding and fixing any issues, in short, proactive plus reactive monitoring combined hold up system reliability. The popular tools currently in use for real-time monitoring and visualization with deep metrics in system performance are Prometheus and Grafana. To use logging with logs, perhaps ELK Stack (Elasticsearch, Logstash, Kibana) and Splunk are best for analyzing logs, looking at patterns, and troubleshooting issues with enhanced overhead visibility and quick solutions. It also helps the team to reduce SRE challenges. High availability comes from redundancy, failover mechanisms, and getting rid of single points of failure. I design systems with load balancing using multiple servers or data centres, implement failover strategies, and ensure backups are available. Monitoring and auto-scaling also help to handle unexpected traffic surges without system downtime. The Playbook is the documentation set of procedures to follow related to specific operational activities or incidents. For example, steps to be taken when a service is down, or in the case of deployment rollback, can be included within this playbook. This ensures that everyone on the team can take action promptly, thus reducing response time in emergencies. Chaos engineering is testing the candidacy of a system in failure by purposefully injecting faults to stress its resilience during a failure, thus checking for weaknesses and failures and improving the systems to act against unexpected behaviour. Teams make their systems even more robust, simulating how the system should behave in a whole system outage. Configuration management is done using tools such as Ansible, Puppet, or Chef to automate and manage all consistent configurations for servers and environments. The configuration management tools avoid manual configuration errors and make system deployments and operations easy to scale. It creates consistent repeatability for the management of infrastructure. Toil being manual and repetitious activities is what you'd want to minimize through automation in SRE. System reliability and efficiency may be enhanced through deploying, scaling, and monitoring through automation by SRE. Enables the guys to get busy innovating and tackling tough problems instead of wasting time doing routine operations. By analyzing bottlenecks and applying some caching techniques, we have optimized a high-latency service. A distributed caching layer was introduced, database queries were optimized, and these two changes resulted in a very large decrease in response time and improvements in overall user experience. Because we improved performance, customer satisfaction has increased markedly. Capacity planning is the forecasting of resource needs in future, based on current usage trends along with the growth that is expected. It ensures that a system can handle increased traffic or demand without allowing performance to degrade. Effective capacity planning prevents bottlenecks, ensuring that the user experience is smooth even during peak usage periods. To reduce the risks of deployment, I have strategies such as canary releases, where changes are rolled out to a small subset of users before a full rollout. Blue-green deployments allow switching between two identical environments, reducing downtime. Automation and continuous integration pipelines also help ensure smooth, error-free deployments. Learning from incidents is possible only through postmortems. They examine the root cause of failures, assess how the incident was handled, and identify improvements. A blameless postmortem culture encourages transparency and learning, leading to preventive actions, process improvements, and more resilient systems to avoid similar issues in the future. On-call responsibilities involve the readiness to react to an incident within a certain time. I make sure I have monitoring tools available and am aware of the escalation paths. While on call, I maintain concentration on finding the root cause of the problem, resolving it in the shortest time possible, and ensuring a seamless handover to the next team member when required. Load testing evaluates how a system behaves under various traffic loads, and hence it will identify bottlenecks and weaknesses. Through simulating high traffic, we can measure the system's ability to withstand increased demand. This helps scale systems efficiently while keeping performance stable during traffic spikes or surges. Error budgets guide prioritization, balancing the need for new features with maintaining service reliability. If reliability falls below the defined SLO, resources shift towards addressing system issues. This ensures that reliability doesn't suffer due to new feature development, maintaining a balance between innovation and system stability. A culture of blamelessness is more on learning from the failure rather than holding a person liable for the cause. It enhances open communication whereby teams can take time to scrutinize incidents without fear of reprisal from punishment. Continuous improvement is always encouraged, team members trust each other, and the resolution of incidents brings better outcomes. Sensitive data can be stored safely and managed, ensuring it's encrypted both in transit and at rest, through tools like HashiCorp Vault or AWS Secrets Manager. Least privilege access principles are used to restrict access to retrieving the necessary secrets for their operation only to those services or users authorized to have them. SRE full form stands for Site Reliability Engineering, a discipline that combines software engineering with IT operations to ensure scalable and reliable systems. The responsibilities of Site Reliability Engineer include monitoring system performance, automating repetitive tasks, implementing incident response strategies, and managing service-level objectives (SLOs). They also handle error budgets to balance system reliability with feature delivery. SREs aim to enhance system efficiency and reduce downtime. It allows you to track changes made in configuration files with a history, and if issues arise, rollbacks are easier. It provides consistency in all environments and allows team members to collaborate on tasks. With the use of version control on configuration files, you can have reproducibility and transparency in handling infrastructure. I handle database migrations in a live environment by doing the following: careful testing in staging environments, use of version-controlled migrations with Flyway or Liquibase, rolling up live migrations, downtime-mitigated migrations in off-peak hours, and having backup strategies on hand for possible failures. It covers all sorts of automated periodic backups, multi-region replication of data, and predefined recovery procedures. I make it a point that disaster recovery plans are always tested on a regular basis so that when systems must restore, they can do so very quickly, without causing too much data loss or downtime, thus ensuring continuity in business operations and reliability in service delivery. I attend industry conferences, participate actively in online forums and communities, subscribe to newsletters, read technical blogs, and continue learning through courses and certifications. All these ensure that I do not remain aloof towards emerging tools, practices, and methodologies that would permeate into making systems more reliable. DevOps vs. SRE showcases two complementary approaches to managing software delivery and operations. DevOps focuses on fostering collaboration between development and operations teams, emphasizing culture, automation, and continuous integration/continuous delivery (CI/CD). SRE, on the other hand, applies engineering practices to ensure system reliability, using concepts like error budgets and service-level objectives. While DevOps drives process improvement, SRE prioritizes system performance and reliability. Together, they enhance efficiency in modern IT practices.

- Identify critical components: Determine which parts of the system must be operational in a disaster. - Define RTO and RPO: Establish Recovery Time Objective (RTO) and Recovery Point Objective (RPO) based on business requirements. - Redundant infrastructure: Implement multi-region failover, with backups in separate geographic locations. - Data backup strategy: Use incremental backups or snapshot-based replication to store data in multiple locations. - Failover automation: Configure automatic failover mechanisms using DNS failover, load balancers, or orchestrators. - Regular DR drills: Simulate disasters and perform failover testing to ensure the DR plan works under stress. - Documentation: Ensure the DR plan is well-documented, accessible, and regularly updated.

Toil refers to repetitive, manual tasks that are necessary but do not add enduring value to the system. To reduce toil: - Automate manual tasks using scripting or orchestration tools like Ansible, Chef, or Kubernetes. - Improve self-healing mechanisms to handle common issues automatically. - Ensure efficient use of monitoring tools to automate alerts and responses, reducing the need for manual interventions.

Idempotency means performing an operation multiple times yields the same result as doing it once. This is crucial for handling retries and failures without side effects (e.g., duplicate charges, duplicate writes). SREs implement idempotency keys, deduplication logic, or use idempotent HTTP methods (PUT, DELETE). It ensures reliability and consistency when requests may be replayed due to network issues or timeouts.

1. It helps manage the risk of change 2. It incentivizes team development 3. It makes it difficult to manage the error budgets 4. It is not related to product development

- SLIs (Service-Level Indicators): Metrics that quantify the reliability and performance of a service, such as latency, error rates, or availability. - SLOs (Service-Level Objectives): Specific, measurable goals for SLIs (e.g., 99.9% availability over a month). - SLAs (Service-Level Agreements): A contractual agreement with customers based on SLOs, specifying consequences if the service doesn't meet the agreed-upon objectives (e.g., service credits). SLIs are the metrics used to measure system health. SLOs define acceptable thresholds, and SLAs represent customer commitments. SLOs drive the reliability goals for an SRE team, while SLIs track how well the system meets them.

- Use cloud-agnostic monitoring tools like Datadog or Prometheus to collect metrics from different cloud providers. - Implement Infrastructure as Code (IaC) tools such as Terraform to manage resources across clouds consistently. - Use multi-cloud dashboards to view consolidated metrics and alerts across clouds. - Ensure network connectivity and security policies are uniformly applied across different cloud providers.

SREs do not pay special attention to the cloud. An SRE, on the other hand, is a general-purpose role whose goal is to manage reliability in any kind of environment.

I developed a Python script to automate log rotation and monitoring on a fleet of servers. It ensured logs didn't fill disks and alerted us proactively if rotation failed or specific error patterns appeared, reducing manual checks and preventing outages.

A service mesh (e.g., Istio, Linkerd) provides a dedicated infrastructure layer for managing service-to-service communication, including traffic management, security (mTLS), observability (metrics, logs, traces), and resilience features (retries, circuit breakers). It offloads these concerns from application code, allowing developers to focus on business logic. SREs use it to improve reliability and security without modifying services.

For background processes, use fork() and execvp(), and do not call waitpid() immediately, allowing the parent to continue. For pipes, use pipe() to create a pipe, then fork() multiple times. Connect stdout of one child to the write end of the pipe and stdin of the next child to the read end using dup2(). Handle errors and ensure proper file descriptor closure.

Define a service level indicator (SLI) such as latency or error rate, set a target threshold (e.g., 99.9% of requests complete under 200ms), establish a measurement window, and monitor burn rate to alert when the error budget is being consumed too quickly.

Google's mission to organize the world's information and make it universally accessible resonates with my passion for building scalable, reliable systems. The company's focus on innovation, user-centric design, and culture of technical excellence provides an environment where I can grow. I am particularly drawn to the SRE role's blend of software engineering and operations to solve complex reliability challenges at global scale.

Use a recursive approach. For a folder, iterate through its child IDs. If a child is a file, add its size. If a child is a folder, recursively compute its size and add it. Store the filesystem structure in a map or tree data structure for efficient lookups. Return the total size.

Observability is the term used to describe the ability of an organization to track real-time events and metrics within a system. Systems that are more Observable are able to capture data from devices within the organization, such as smartphones and tablets. This data can then be used to track activities within the organization, such as the number of employees who log into work each day. There are many different types of observability within an organization, including: - Real-time monitoring: This type of observability allows users in the organization to monitor what is happening in real time. This includes things like the number of people who visit a website on their phone or tablet. - Historical monitoring: This type of observability allows users in the organization to view data from previous periods. This type of observability may be most useful when tracking financial transactions, such as how much money has been spent over time. - System-wide monitoring: This type of observability can be used across all devices in an organization, including phones and computers. System-wide monitoring allows users in the organization to view data across all devices within the organization. We can increase the observability of the organization by - - Recognize the sorts of data that flow from an environment and which of those data types are relevant and valuable to your observability goals. - Determine how your strategy is making sense of data by distilling, filtering, and translating it into actionable insights regarding the performance of your systems. Observability can provide helpful information about an organization's DevOps maturity level.

I'm fairly experienced with DNS and basic networking concepts. DNS, or Domain Name System, is the protocol within the set of standards for how computers exchange data on the Internet and on a private network. It's often thought of as the phonebook for the internet, translating human-readable domain names into IP addresses that machines can understand. In terms of networking, I understand the concepts of subnets, virtual networks, IP addressing, network protocols like TCP/IP, HTTP, HTTPS, FTP, and more. I've worked with firewalls, routers, and switches. I've also handled NAT configurations and am familiar with the concepts of public and private networks, port forwarding, and network troubleshooting using tools like ping, traceroute, netstat, etc. Specifically, for example, in one of my previous roles, I had to debug a DNS related issue where the application was inconsistent in resolving a particular domain name. I employed my understanding of DNS workings and network debugging to troubleshoot the issue which turned out to be due to a misconfigured DNS caching mechanism. We fixed the mechanism and also refined our DNS resolution method to add redundancy and increase reliability.

- Run containers as non-root users. - Scan images for vulnerabilities (e.g., Trivy). - Enable Docker Content Trust.

An error budget policy demonstrates how a business decides to trade off reliability work against other feature work when SLO indicates a service is not reliable enough.

The three pillars here are logging, metrics, and tracing. Observability as a whole is intrinsic to the SRE field. 'The science of measuring a system is core to what SREs are hired for,' Lachhman says, pointing to the 'Four Golden Signals' in Site Reliability Engineering as one basis for thinking about this question. 'Which pillar would help you determine those [signals] the best?' Lachhman asks. 'These will eventually lead into your SLO/SLI measurements. Showing interest in one or more of the pillars shows you are ready to grow into your role.' As a general principle, measurement is critical in any SRE position, so keep this in mind if you're looking to pivot into this role from another IT area: It's a data-driven discipline.

Observability measures the system output and analyzes its process's efficiency, using tools like metrics, logs, and tracing. Generally, SREs are responsible for observability and incident response in the software development life cycle. The three pillars of observability are logging, metrics, and tracing. The interviewee wants to test the candidates' understanding of observability and how you could help their organization implement this approach.

Stateful applications in a containerized environment are managed using StatefulSets in Kubernetes, which provide stable network identities, persistent storage, and ordered deployment and scaling for stateful applications.

Like any job interview, you need to explain your desire and passion for the SRE role as it is not one of the easiest roles and comes with a lot of responsibilities and pressure. This is an excellent chance for you to display that you are enthusiastic about the role, building services that improve system reliability and lead to greater customer satisfaction. You can explain how being part of an SRE team allows you to make an impact that affects everyone, from product managers to end-users. You can add a couple of experiences you had in a similar role elsewhere and how it was beneficial to the larger organization.

Strategies include: using the Strangler Fig pattern to incrementally replace monolithic functionality with microservices, starting with low-risk, non-critical features. I maintain backward compatibility through API gateways and feature flags. I implement strong testing (e.g., contract tests) and use blue-green deployments for seamless transitions. Observability is enhanced with distributed tracing to monitor dependencies. Rollback plans are critical. The migration is phased, with each step validated against SLOs to ensure reliability is maintained.

- Docker is a platform for containerizing applications. - Kubernetes is a container orchestration tool used to manage and scale containerized applications across multiple hosts, offering self-healing, load balancing, and automated deployment.

Companies may lower software operating expenses by recruiting skilled software developers and operations staff. Avoiding availability and reliability concerns after launch makes modest improvements simpler to develop and deploy.

Chaos Engineering involves deliberately introducing failures into a system to test its resilience and identify weaknesses before they cause real problems.

Linux has two different types of shells:

Python is the default. Go is increasingly common at infrastructure-heavy companies. The language matters less than whether your code handles edge cases: malformed log lines where the timestamp is in a different format than your parser expects, missing fields that cause a nil dereference, or files that are larger than available memory because someone turned on debug logging during an incident and forgot to turn it off.

In a push model, agents or services send metrics to a central monitoring system (e.g., via Prometheus remote write or StatsD). In a pull model, the monitoring system queries targets for metrics (e.g., Prometheus scraping endpoints). Pull models simplify discovery and control over data collection frequency, while push models can handle transient services or environments with network restrictions. SREs choose based on system architecture and scalability needs.

Do the candidate's steps match with your company's? Close? Is the candidate open to suggestions or do they act like they have the definitive answer (like a know-it-all)?

IaC is the practice of managing and provisioning infrastructure (servers, networks, databases) through machine-readable definition files (e.g., Terraform, CloudFormation, Ansible). It enables version control, reproducibility, automation, and consistency. SREs use IaC to eliminate manual configuration, reduce snowflake servers, and deploy infrastructure changes with the same rigor as application code (CI/CD, testing, rollbacks).

An error budget is the allowable amount of downtime or failures for a service within a specific time frame, balancing the need for reliability with the pace of innovation.

S – Situation During a routine capacity planning review, I was analyzing our database performance metrics for our main customer profile service, which is a critical backend responsible for fetching all user-specific data. While the database server's CPU and memory usage remained consistently within healthy limits, I observed a subtle but consistent upward creep in the average database query execution times for this service over several weeks. It wasn't triggering any immediate alerts, as it was still within acceptable thresholds, but the trend was concerning. A degradation in this service could quickly cascade, impacting user experience across numerous applications. T – Task My task was to investigate this subtle performance creep, identify its underlying root cause, and implement a solution before it reached a critical threshold and manifested as a user-facing issue or a widespread outage. The goal was to maintain our stringent latency Service Level Objectives (SLOs) for the customer profile service and ensure its long-term stability and scalability under growing load. This required a proactive, investigative approach to diagnose a problem that hadn't yet become critical but showed clear potential to do so. A – Action I began by diving deep into our database performance monitoring tools, focusing specifically on slow query logs and examining execution plans for the customer profile service. I correlated the increasing query times with specific query patterns and discovered that a frequently executed query, responsible for fetching user preferences based on various optional criteria, was sometimes performing a full table scan. This was particularly problematic when certain optional parameters were not provided in the API request. Under typical conditions, with all parameters present, existing indexes made the query highly efficient. However, an increasing number of new integrations were calling this API with fewer specific parameters, causing the database optimizer to choose a less efficient plan due to the absence of a suitable index for these broader queries. My hypothesis was that a composite index on the user_id and the most frequently queried optional fields would drastically improve performance for these broader queries without negatively impacting existing, optimized queries. I worked closely with our database administrator to create and rigorously test this new composite index on a staging replica. We carefully monitored its impact on other queries, storage, and write performance to ensure there were no unintended side effects. Once thoroughly validated, I coordinated a deployment during a low-traffic maintenance window to minimize any potential disruption. Additionally, recognizing that some of the issue stemmed from how consumers were interacting with the API, I initiated conversations with the development teams consuming the customer profile service API, providing them with clear guidance on optimal query patterns and educating them about the performance implications of broad searches without specific parameters. R – Result The implementation of the composite index immediately reduced the problematic query's execution time by over 80%, bringing the average database query latency for the customer profile service back within healthy operational bounds, well below its SLO. We observed a significant decrease in database I/O, which also freed up valuable resources for other critical services sharing the same database instance. This proactive intervention successfully averted what could have become a major performance bottleneck or even a service outage during peak usage periods. As a direct outcome of this experience, we introduced automated SQL query linting into our CI/CD pipelines for all services interacting with critical databases. Furthermore, we established a mandatory review process for all new or modified database queries by an SRE or dedicated Database Administrator during the pull request phase. These measures ensured that similar indexing issues or inefficient query patterns would be caught much earlier in the development lifecycle, embedding reliability and performance considerations deeper into our engineering practices and preventing potential issues from ever reaching production.

- Controlled environment: Start with staging or test environments before introducing chaos experiments in production. - Gradual rollout: Use canary testing or chaos in low-impact areas first, ensuring only a small portion of the system or user base is impacted. - Abort mechanisms: Implement an immediate abort or rollback mechanism to stop the experiment if it leads to critical failures. - Monitor key metrics: Track SLIs like latency, error rates, and availability during experiments to avoid SLO violations. - Scheduled chaos experiments: Conduct chaos experiments during off-peak hours or in controlled windows to minimize the risk to users. Chaos engineering in production must be well-controlled, with quick recovery mechanisms in place to prevent system-wide outages.

The answer to this question will vary from team to team. Generally, this is an opportunity for you to highlight: - The importance of SRE - How you've used site reliability engineering in the past to bolster resilience and productivity Some organizations will have dedicated DevOps teams where others will simply follow DevOps methodologies. You'll appease the interviewer as long as you're thoughtful about the way you've used SRE in the past and how you see it contributing to overall reliability and efficiency in IT and software development in the future.

Height: Recursively compute the maximum depth from root to leaf. For a node, height = 1 + max(height of left subtree, height of right subtree). Leaf levels: The number of leaf levels in a complete binary tree with X nodes is determined by the tree's structure. The minimum number of leaf levels is 1 (if all leaves are at the same depth), and the maximum is approximately log2(X) + 1.

An error budget is the maximum acceptable amount of unreliability, defined as 100% minus the SLO. It represents the allowable downtime or error rate. SREs use error budgets to balance innovation with reliability: if the budget is not exhausted, teams can release new features; if it is depleted, they must focus on stability and reliability improvements.

- Replication for redundancy and failover. - Sharding to split data across multiple servers for horizontal scaling. - Backups and automated restores for data recovery. - Tuning queries and indexes for performance optimization.

Strong candidates emphasize systemic improvements over individual blame and can describe how blameless culture encourages honest incident reporting.

SRE merges software engineering with infrastructure management to ensure systems are reliable, scalable, and cost-effective. Key tasks include automating deployments and defining SLOs.

Use centralized logging (ELK, Loki), metrics (Prometheus + Grafana), tracing (OpenTelemetry), and alerting systems (Alertmanager, PagerDuty). Focus on golden signals: latency, traffic, errors, saturation.

The usefulness of error logs greatly depends on how well they are structured and the information they capture. In my approach to logging, I always make sure that each log entry contains certain essential elements: a timestamp, the severity level of the event (like INFO, WARN, ERROR), the service or system component where the event occurred, and a detailed but clear message describing the event. For errors or exceptions, including the stack trace in the log is crucial as it provides a snapshot of the program's state at the point where the exception occurred. This information is incredibly useful when debugging. Additionally, if there are any relevant context-specific details, such as user id, transaction id, database id in the context of the event, including them in the logs can help make connections faster during troubleshooting. Finally, consistency across all logs is the key. Following a standard logging format helps in parsing the logs later for analysis. I also periodically review our logging practices as part of a continuous improvement process, to ensure we are only collecting data that helps us maintain and improve our systems.

When I design for high availability, I start by defining what 'available' actually means for that service—what's our uptime target? Then I work backward from there. I implement multi-region or multi-zone deployments so no single point of failure brings everything down. I use load balancers to distribute traffic and automated failover to handle regional outages. For stateful services, I ensure data replication across regions with eventual consistency in mind. I pair this with comprehensive monitoring—Prometheus for metrics, structured logging, and distributed tracing—so we catch issues before users do. And I always design runbooks for common failure scenarios. In my last role, we implemented this for our payment processing service and reduced our mean time to recovery from 45 minutes to under 5 minutes.

Border Gateway Protocol routes traffic between autonomous systems (e.g., internet backbone).

DevOps involves the organization of silos, while S3 shares ownership and accepts failures as normal. S3 focuses on measuring reliability of service through metrics, capacity planning, change management, emergency response, and culture.

Comparison Parameters | Hard link | Soft link | |---|---|---| | Inode number* | Files that are hard linked take the same inode number. | Files that are soft linked take a different inode number. | | Directories | Hard links are not allowed for directories. (Only a superuser* can do it) | Soft links can be used for linking directories. | | File system | It cannot be used across file systems. | It can be used across file systems. | | Data | Data present in the original file will still be available in the hard links. | Soft links only point to the file name, it does not retain data of the file. | | Original file's deletion | If the original file is removed, the link will still work as it accesses the data the original was having access to. | If the original file is removed, the link will not work as it doesn't access the original file's data. | | Speed | Hard links are comparatively faster. | Soft links are comparatively slower. |

At Grab, I identified that our payment processing system was facing frequent downtimes during peak hours, impacting transaction success rates. I led a team to implement automatic scaling and introduced a load balancer to distribute traffic more evenly. As a result, system uptime improved from 92% to 99.9%, significantly enhancing user trust and transaction volume during peak times.

Observability is the ability to measure the internal state of a system based on its outputs (logs, metrics, traces). It helps in understanding system behavior and diagnosing issues.

Design a system for serving ads based on search queries. Components: ad index, auction system, ad server, and tracking. On a query, the ad server retrieves relevant ads from an inverted index, runs an auction considering bid price and quality score, and returns winning ads. Use distributed systems for low latency, caching for hot queries, and load balancing. Handle billions of queries with sharding and replication.

Load balancers improve reliability and high availability by distributing incoming traffic across multiple servers or instances, preventing any single server from becoming a bottleneck or single point of failure. They perform health checks to route traffic away from unhealthy servers, enable automatic failover, and allow for scaling up or down based on demand, ensuring consistent performance and uptime.

Another perspective in the Service Risk (S.R.) approach is to measure the ability by dividing the good interactions by the total interactions we have to a service or product. This allows us to handle distributed services and more complex architectures.

This is a detailed version of the question asking to explain the full sequence of events, including DNS resolution, TCP handshake, TLS negotiation, HTTP request/response, and rendering, that occur when a URL is entered into a browser.

A Docker container is a lightweight, standalone, executable package that includes an application and its dependencies. To secure containers, I use minimal base images, avoid running as root, scan for vulnerabilities, implement network policies, use secrets management, restrict capabilities, and enforce resource limits.

Troubleshooting intermittent network issues in distributed systems can be challenging due to the complexity and variability of the problem. Here's how I approach it: - Collect Metrics: Start by gathering network metrics (latency, packet loss, throughput) from tools like Prometheus, Grafana, or Datadog. - Check Logs: Investigate logs from network devices, containers, and services to find patterns that might indicate the source of the issue. - Reproduce the Issue: Try to reproduce the problem under controlled conditions using chaos engineering tools or load tests to determine if it's related to traffic volume or specific operations. - Trace Requests: Use distributed tracing tools like Jaeger or OpenTelemetry to trace requests across services and pinpoint where the network issue might be occurring. - Check Infrastructure Components: Investigate switches, routers, and firewalls for issues such as congestion, misconfigurations, or overloaded resources. Once the root cause is identified, I ensure the issue is resolved and put preventive measures in place.

Content Delivery Network caches static assets globally to reduce latency (e.g., Cloudflare).

Capacity planning involves predicting future resource needs and ensuring that the infrastructure can handle anticipated growth and load without compromising performance.

The F3 approach to operations stresses data-driven decision-making and separating operations and software engineering challenges. It needs software engineers on both sides, including coders and post-launch support.

- Implement auto-scaling to adjust the number of resources based on actual usage. - Use reserved instances for predictable workloads and spot instances for non-critical, flexible workloads to reduce costs. - Monitor resource utilization with tools like CloudWatch or Datadog to identify underutilized resources and right-size instances. - Use storage tiers to reduce costs, storing frequently accessed data in faster (and more expensive) storage, while infrequently accessed data is moved to slower (and cheaper) options. - Regularly audit cloud spend using tools like AWS Cost Explorer and optimize where possible.

Expect seasoned SREs to have hands-on experience with tools like Ansible, Chef, Puppet, or SaltStack and to give examples of instances where they've used them to automate the setup and management of software and servers. Look for examples of how these tools have helped ensure consistency across environments, facilitated scalability, and improved operational efficiency.

Answer: Killall:This command is used to kill all the processes with a particular name. PKill: This command is like kill all, except it kills only processes with partial names. Xkill: This command allows users to kill the command by clicking on the window.

Follow an incident response plan: - Acknowledge the alert. - Diagnose the issue using logs, metrics, and monitoring tools. - Resolve or mitigate the issue by rolling back, fixing configurations, or other actions. - Document and perform a postmortem to prevent future incidents.

RAID 0 uses striping, which splits the data across two or more disks. RAID 5 is striping with parity, which provides some error detection. RAID 0 strictly emphasizes performance while RAID 5 introduces fault tolerance at the expense of somewhat lower performance.

Because of SRE's involvement in so many aspects of the engineering organization and business, it's important that you can identify human bottlenecks in productivity. With this question, the interviewer is trying to determine how you would go about solving issues between cross-functional teams. Most of the time, it's as simple as finding ways to improve the communication and visibility across different departments – helping people find the information they need when they need it.

A hard link is a direct pointer to the inode of a file; it shares the same inode number and data blocks. Deleting the original file does not affect hard links. Soft (symbolic) links are special files that contain a path to the target file; they have their own inode and can span filesystems. Deleting the target breaks a soft link.

The SRE landscape evolves rapidly. To stay current, I: - Attend Conferences: I regularly attend SREcon and other industry conferences to learn about new tools and best practices. - Follow Thought Leaders: I follow blogs, podcasts, and thought leaders like Charity Majors, David N. Blank-Edelman, and others who provide insights into evolving SRE practices. - Experiment with New Tools: I proactively experiment with new tools like ArgoCD for continuous deployment or Prometheus Operator for Kubernetes monitoring to stay ahead of the curve. - Community Engagement: I participate in Slack channels, Reddit threads, and GitHub repositories to share knowledge with peers and engage in discussions about the latest advancements in the field. Keeping up with these resources helps me remain proficient in the latest tools and practices.

SLIs (Service Level Indicators) are specific metrics used to measure service performance (e.g., response time, error rate). SLOs (Service Level Objectives) are the target values for those metrics.

Blameless postmortems focus on understanding the root cause of an incident without assigning blame. The goal is to learn from the incident and improve systems to prevent future occurrences.

Certainly, at my last role, our team was tasked with migrating our on-premise systems to a cloud-based environment for better scalability and maintainability. I played a key role in designing and implementing this migration. Our first step was to audit the current system's architecture and dependencies, identify potential bottlenecks in moving to the cloud, and map out a detailed migration plan. I helped design the new cloud architecture, taking into account factors like our growing user base, data storage needs, and security requirements. We used Amazon Web Services, making use of their EC2 instances for computing, RDS for the Databases, and S3 for storage. Once the new system design was reviewed and approved, we proceeded with a phased migration approach, moving one module at a time, which minimized disruption to ongoing operations. Each phase was followed by rigorous testing and performance tuning. By the end of the project, we successfully transitioned our entire system to the cloud, achieving huge gains in scalability, reliability, and cost efficiency. Not only that, but the team also became adept at managing and maintaining cloud-based environments in the process.

Noisy logs can overwhelm teams and make troubleshooting inefficient. Here's how I manage them: - Structured Logging: I use structured logging with JSON format, making logs more readable, searchable, and consistent across services. - Log Levels: I ensure logs are categorized with proper log levels (ERROR, WARN, INFO, DEBUG). Only critical alerts trigger higher-severity logs, reducing the noise. - Log Aggregation: I integrate tools like ELK Stack (Elasticsearch, Logstash, Kibana) or Splunk for aggregating logs across systems. These allow for centralized viewing, filtering, and real-time analysis. - Automated Alerts for Critical Logs: Set up intelligent alerting using Prometheus and Grafana, which will only notify teams of critical issues that need immediate attention. - Log Retention & Cleanup: Regular cleanup and retention policies ensure logs don't accumulate unnecessarily, which can affect system performance. By managing the volume and quality of logs, troubleshooting becomes more focused and efficient.

Stores non-sensitive configuration data (e.g., environment variables).

Under /proc, there are three subdirectories:

A failover system automatically switches to a backup system or component when the primary one fails, ensuring continuous availability.

To reverse a linked list in Go, you can iterate through the nodes and adjust the pointers accordingly. Here's a simple function to achieve this: func reverseList(head *ListNode) *ListNode { var prev *ListNode; curr := head; for curr != nil { next := curr.Next; curr.Next = prev; prev = curr; curr = next; } return prev; }

The appropriate SRE tools for each stage of DevOps are: Plan: Jira, Pivotal Tracker, and other task management tool Create: Source-control tools like GitHub Verify: CI/CD tools like Jenkins or CircleCI Package: Container orchestration services like Kubernetes or Mesosphere. Configure: Tools like Terraform and Ansible

DHCP or Dynamic Host Configuration Protocol is the protocol that provides an Internet Protocol (IP) host with its IP address as well as any additional necessary configurations.

- Proactive Monitoring: Identifies potential issues before they occur (e.g., analyzing trends, anomaly detection). - Reactive Monitoring: Responds to alerts when problems occur (e.g., server crash).

Rate limiting controls the number of requests a client can make to a service within a time window, preventing abuse, ensuring fair usage, and protecting the system from overload. Implementation can be via token bucket, leaky bucket, or sliding window algorithms, enforced at the application or API gateway level. SREs configure limits based on capacity planning and use headers to inform clients of remaining quota and retry timing.

The first thing candidates should do is to give you context, i.e. explain the problem they faced. The best applicants will then explain how they considered additional requirements, as well as the need for scalability and maintainability of their script. Then, they'll provide details about the language they chose and why. For example: Python for its simplicity and rich libraries, or JavaScript for its asynchronous capabilities, or Go for its efficiency and performance.

Keeping up-to-date in the rapidly evolving tech industry is indeed a challenge, but there are several strategies I use. I find technical blogs and websites like TechCrunch, Wired, and A Cloud Guru to be valuable resources for the latest news and trends. I also regularly follow technology-focused websites like Stack Overflow, DZone, and Reddit's r/devops subreddit, where professionals in the field often share their experiences, best practices, and resources. Attending webinars, conferences, and meetups is another way I stay updated and network with other professionals. Events like Google's SREcon or the DevOps Enterprise Summit are especially useful for Site Reliability Engineers. I take online courses or tutorials on platforms like Coursera, Pluralsight, or Udemy to learn new technologies or deepen my understanding of current ones. I also read technical white papers from major tech companies like Google, Amazon, or Microsoft to understand their architecture and practices. Finally, I participate in open-source projects when possible, as it not only helps in learning by doing but also gives exposure to the real-world challenges others are trying to solve in the field.

Key responsibilities include monitoring system performance, managing incidents, automating operational tasks, ensuring system reliability and availability, and improving infrastructure scalability.

- RTO (Recovery Time Objective) = How fast you can recover - RPO (Recovery Point Objective) = How much data loss is acceptable Used in disaster recovery planning.

The smallest deployable unit in Kubernetes, hosting one or more containers.

Iterate through the array, keeping track of the minimum value seen so far. For each element, if it is greater than the minimum, check if there is a previous element that is less than it and greater than the minimum. Use auxiliary arrays: left_min[i] stores the smallest value to the left of i, and right_max[i] stores the largest value to the right of i. Then find a j where left_min[j] < a[j] < right_max[j]. Return indices i, j, k.

A garbage collector automatically manages memory by reclaiming memory occupied by objects no longer in use. Common algorithms include: mark-and-sweep (marks reachable objects, then sweeps unmarked ones), reference counting (tracks references to objects), and generational collection (divides objects by age for efficiency). It typically runs periodically or when memory is low.

S – Situation During a major holiday sale, our critical payment processing microservice started experiencing intermittent 500 errors and high latency, impacting a significant percentage of users at peak transaction volume. Our monitoring dashboards, typically robust, were showing a sea of red, but the alerts weren't pinpointing a clear root cause immediately. The potential revenue loss and customer frustration were escalating rapidly, making it a high-pressure situation for the entire engineering team. The initial investigation couldn't immediately correlate the issue with any recent deployments or configuration changes within the payment service itself, which added to the mystery. T – Task My primary task was to act swiftly to identify the root cause of the payment service degradation, restore full functionality to minimize business impact, and then implement measures to prevent recurrence. This involved rapid diagnosis, effective communication, and coordinated action across multiple teams while under immense time pressure. The urgency stemmed from the fact that every minute of downtime directly translated to lost sales and damaged customer trust during one of our busiest periods. It wasn't just about fixing the immediate problem, but about understanding the systemic issues that allowed it to occur. A – Action I immediately joined the incident management war room, taking point on the technical diagnosis. My first step was to scrutinize recent deployments and configuration changes, not just within the payment service, but across its immediate upstream and downstream dependencies. When that didn't yield a direct hit, I pivoted to our centralized logging system, an ELK stack, correlating logs across various microservices and infrastructure components. I observed a sudden, sharp increase in database connection errors originating from the payment service instances, which was unusual as its database connection pool was adequately sized. Diving deeper, I then correlated these errors with increased query loads on a shared database instance. This revealed that a recently deployed, seemingly minor change in an unrelated inventory service was making excessive, unoptimized calls to this shared database, effectively exhausting its connection pool. The payment service, while not directly changed, was experiencing collateral damage due to resource starvation. I swiftly coordinated with the database operations team to temporarily increase the connection limits on the affected database and worked with the inventory service team to roll back their problematic deployment. In parallel, I deployed a hotfix to the payment service to implement a more robust retry mechanism with exponential backoff and a circuit breaker pattern, allowing it to gracefully handle transient database unavailability while the core issue was being fully addressed. I also spun up more granular database connection pool monitoring specific to the payment service to ensure we had real-time visibility into this critical resource. R – Result Within 45 minutes of identifying the root cause, the payment service was fully recovered, with error rates returning to normal and latency stabilizing. The rollback of the inventory service's deployment permanently resolved the database contention issue. The incident post-mortem revealed a critical gap in our pre-deployment load testing, particularly concerning shared resources and cross-service dependencies. As a direct result, we implemented stricter integration testing requirements for any service interacting with shared infrastructure like common databases, mandating that these tests simulate realistic concurrent load scenarios. We also introduced automated chaos engineering experiments into our staging environments to simulate resource exhaustion scenarios, such as database connection pool limits, to proactively uncover such vulnerabilities before they impact production. Furthermore, our monitoring was enhanced with early warning indicators for shared resource saturation, preventing similar incidents from escalating in the future. This experience underscored the importance of a holistic view of system interactions, the need for comprehensive testing beyond individual service boundaries, and the value of rapid rollback capabilities as a first line of defense.

To implement logging in a microservices architecture, I would use a centralized logging system like the ELK stack to aggregate logs from all services. This approach ensures that logs are structured and easily searchable, facilitating efficient monitoring and debugging.

Capacity planning involves analyzing historical performance data and trends (e.g., CPU usage, disk I/O) to predict future demand. Use this data to provision resources in advance, ensuring systems can handle peak loads without over-provisioning.

Schema migrations in a distributed database are handled using migration tools (like Flyway or Liquibase), versioning schemas, implementing backward-compatible changes, and coordinating deployments to ensure data consistency and minimal downtime.

SREs use the error budget framework to balance these priorities. As long as the error budget (allowed unreliability) is not exhausted, teams can focus on feature development. When the budget is depleted, reliability work takes precedence. Additionally, SREs advocate for investing in automation and infrastructure that reduces toil, which indirectly frees time for both features and reliability. Regular reviews of incident data help prioritize reliability projects.

A Service Level Indicator (SLI) is a measure of the service level provided by a service provider to a customer. SLIs form the basis of Service Level Objectives (SLOs), which in turn form the basis of Service Level Agreements (SLAs). An SLI can also be called an SLA metric. Although every system is different in the services provided, common SLIs are used pretty often. Common SLIs include latency, throughput, availability, and error rate; others include durability (in storage systems), end-to-end latency (for complex data processing systems, especially pipelines), and correctness.

Chaos engineering is about intentionally injecting faults into your systems to test how well they handle disruptions. Here's how I would introduce it: - Educate and Explain: Start by explaining that chaos engineering helps discover weaknesses before they impact customers. It's like “fire drills” for systems, ensuring resilience in production environments. - Introduce Tools: Use tools like Gremlin or Chaos Monkey (from Netflix's Simian Army) to simulate failures like server crashes or network latency. - Start Small: Begin with non-critical services and set controlled conditions. Gradually increase the complexity of the faults being introduced. - Metrics and Monitoring: Implement strong monitoring systems like Prometheus or Datadog to track system behavior during experiments. This will help quickly identify and fix issues. - Blameless Postmortem: After each experiment, conduct a blameless postmortem to identify lessons learned and areas of improvement without blaming individuals. Introducing chaos engineering in a safe and controlled manner builds confidence and improves the system's overall resilience.

At a previous role in a cloud services company, we experienced a major outage due to a misconfigured load balancer. I quickly assembled the team and we identified the misconfiguration within 30 minutes. After restoring service, we conducted a thorough post-mortem, which led to implementing stricter configuration management practices, reducing similar incidents by 60%.

Some SRE tools are:

- Synchronous Communication: Services communicate in real time (e.g., REST APIs). It introduces latency and increases the risk of cascading failures. - Asynchronous Communication: Services send messages without waiting for a response (e.g., message queues like RabbitMQ or Kafka). This decouples services, improving reliability and availability.

The Secure Shell (SSH) protocol provides a secure way to send commands to a computer over an unsecured network. It uses cryptography to authenticate and encrypt connections between devices.

This is a real tension, and I think the honest answer is that it's not always clear-cut. When a critical system has high error rates, that's an obvious 'reliability first' decision. But when a development team wants to ship a feature and you want to refactor the deployment pipeline, that's trickier. I've found that making the business impact visible really helps. When we had a 20-minute deployment window, developers couldn't iterate quickly and took shortcuts in testing. I quantified it: we were losing about 3 hours per developer per week. When I showed the leadership team that refactoring our CD pipeline would save us 6 hours per developer per week, they funded it. It wasn't a preachy 'reliability is important' conversation—it was about enabling developers to move faster while reducing incident risk. Error budgets actually help here too. If we have error budget left, we can take calculated risks with feature deployments. If we're over budget, we collectively agree to focus on stability. That makes the tradeoff explicit.

Candidates should explain that: Service Level Indicators (SLIs) are specific, measurable characteristics of the service, such as latency or error rate. Service Level Objectives (SLOs) are the target values for SLIs that the service aims to meet. Service Level Agreements (SLAs) are contractual agreements with customers that include consequences for not meeting SLOs. Skilled SREs will understand how these concepts help to set, measure, and manage the performance and reliability of services.

Cloud computing means storing and accessing the data and programs on remote servers that are hosted on the internet instead of the computer's hard drive or local server. Cloud computing is also referred to as Internet-based computing, it is a technology where the resource is provided as a service through the Internet to the user. The data which is stored can be files, images, documents, or any other storable document.

Common challenges include: cultural resistance to change (e.g., from traditional ops), lack of buy-in from management, difficulty measuring reliability accurately, insufficient automation or tooling, balancing reliability with feature velocity, and hiring SREs with the right skills (both coding and operations). Successful adoption requires leadership support, clear SLOs, training, and a gradual approach to implementing SRE practices.

Situation: We were under deadline to ship a major feature, and I recommended we delay because our testing infrastructure wasn't reliable enough. Task: I knew delaying would be unpopular with leadership and the product team, but I believed it was the right call. Action: I presented data: we had failed to catch issues in testing 40% of the time over the past quarter. When those issues reached production, we had to deal with emergency patches. I showed the cost of an hour of production outage versus one week of delay. I also offered to help fix the testing infrastructure and gave a realistic timeline. I wasn't saying 'no'—I was saying 'not yet, here's why, here's how we fix it.' Result: Leadership agreed to delay two weeks. We made improvements to testing, and we caught issues in the new feature before it went live. But I've also had situations where I made the case and leadership decided differently. I respected that decision—ultimately, it's not my call to make alone.

Monitoring and alerting are important in Site Reliability Engineering (SRE) because they help identify potential issues before they cause outages. Monitoring tools provide real-time insights into system performance, infrastructure health, and user behavior. Monitoring Tools Include: Alerting Tools Include:

Yes, I have deployed applications to Amazon EKS. The process involves: 1. Creating an EKS cluster using eksctl or the AWS Management Console. 2. Configuring kubectl to connect to the cluster using the kubeconfig file. 3. Building a Docker image of the application and pushing it to Amazon ECR. 4. Creating Kubernetes deployment and service YAML files that reference the image from ECR. 5. Applying the manifests using kubectl apply -f .yaml. 6. Exposing the service using a LoadBalancer or Ingress for external access.

An SRE is responsible for being an on-call efficiency and quality of life steward. Hence for any SRE interview, it's likely you'll need to show how you would go about setting up a humane on-call experience. For example, a candidate should explain that on-call should focus more on people when setting up on-call rotations and alert rules instead of processes and tools.

Mentoring involves regular pair programming, code reviews, and knowledge sharing sessions. I would establish SRE standards (e.g., runbook templates, monitoring practices) and promote a culture of automation by allocating time for toil reduction projects. To scale, I would create documented processes, define on-call rotations, and use tools like chatbots for paging. I encourage team members to lead reliability initiatives and share learnings. Success is measured by reduced toil hours, improved MTTR, and consistent adherence to SLOs.

An error budget is a concept in site reliability engineering that quantifies the acceptable level of risk or unreliability for a service. It is usually defined as a small percentage of total uptime. The error budget provides a balance between the need for rapid innovation and system reliability. If we're within our error budget, we can continue to push new features. However, if we're close to exhausting the budget, it's a signal to focus more on system reliability. This approach allows for informed decision-making and a common language between the development and operations teams.

A TCP connection state is a relationship between a client TCP endpoint and a server TCP endpoint. These states are defined by the TCP three-way handshake process. The three-way handshake process allows TCP to establish a connection between two endpoints, where one side initiates a connection setup using an SYN packet, while the other side responds with an ACK packet. Once both sides have sent and received their respective SYN and ACK packets, an established connection is created. After the connection is established, a client can initiate data transfer over this connection by initiating a FIN packet, which will cause the server to send back an ACK packet indicating that all outstanding data has been successfully received and stored in memory. This process of sending and receiving packets works as long as there is no unexpected network congestion or other unforeseen events that cause either side to disconnect. The different states of a TCP connection are defined as follows: - LISTEN - The server is listening on a certain port, such as port 80 for HTTP. - SYNC-SENT - Sent an SYN request and is awaiting a response. - RECEIVED SYN - (Server) Waiting for an ACK occurs after the server sends an ACK. - ESTABLISHED - The three-way TCP handshake has been finished.

I assess the impact of technical debt on reliability, velocity, and cost using metrics like incident frequency, error budgets, and developer productivity. If error budgets are depleted or debt is causing frequent outages, I prioritize paying down debt. Otherwise, I balance based on business value, risk, and long-term sustainability, often involving stakeholder input.

Building scaled and dependable software requires the F3 operations and Service Risk (S.R.) approaches. Understanding the error budget and monitoring the capacity to manage dispersed services and complicated architectures helps us maintain product availability and functionality.

I have established shared goals and SLOs, implemented cross-functional team structures, conducted joint incident reviews and blameless postmortems, created shared communication channels, and introduced regular sync meetings to align on priorities and reduce silos.

SREs monitor health using a combination of: synthetic monitoring (simulating user requests), real user monitoring (RUM), metric collection (latency, error rates, throughput, saturation—the USE method), log analysis, and distributed tracing. They set up dashboards and alerts based on SLOs, and use health checks for individual services. Observability tools (like Prometheus, Grafana, ELK) provide insights into system behavior and help detect anomalies early.

In such a situation, my first step would be to acknowledge the incident and communicate the issue to stakeholders. Next, I would use monitoring tools to identify the root of the performance degradation. After the problem has been isolated, I would apply a temporary fix or rollback, if possible, to restore service quickly. Once the immediate issue is resolved, I would analyze the incident to understand why it happened, and make necessary adjustments to prevent recurrence. Afterward, a post-mortem analysis would be shared with all concerned parties.

Identity and Access Management controls permissions for cloud resources.

Like most other job interviews, it's important to show why you're excited about the role. SRE isn't always viewed as the most luxurious role, and many developers will shy away from it. So, it's important to speak to why you're excited about building services that improve system reliability and lead to greater customer and employee happiness. Being part of an SRE team should excite you because you'll be able to make a large impact that affects everyone from product managers to end users.

SRE is a discipline that incorporates software engineering practices to solve infrastructure and operational challenges, aiming to create scalable and reliable systems. SREs focus on automation, monitoring, and enhancing system reliability while balancing feature velocity and operational stability.

When dealing with on-call emergency issues, the first thing I do is quickly assess the situation, gathering as much initial information as possible about the problem – when it started, what part of the system it's affecting, and any error messages or logs. This initial data helps guide the next steps.

(Behavioral) The candidate should describe a specific incident, focusing on their role in detection (e.g., monitoring alert), containment (e.g., rolling back a bad deployment, isolating traffic), communication (e.g., updating stakeholders via status page), resolution (e.g., applying a fix, scaling resources), and postmortem (e.g., identifying root cause and preventive actions). Key aspects: staying calm, following runbooks, collaborating with the team, and learning from the incident.

Lessons include the importance of explaining thought processes clearly, not just solving problems. Candidates learn to handle ambiguity in system design questions, prioritize reliability over features, and stay calm under pressure. Another key insight is to be honest about knowledge gaps and to show a willingness to learn and collaborate.

A canary release involves deploying a new version of a service to a small subset of users to test its performance before rolling it out to the entire user base.

This tests whether candidates can explain latency, traffic, errors, and saturation while connecting each signal to specific troubleshooting scenarios.

SLA service level agreement is mostly relative to a business and defines what you're willing to do if you're failing to meet your objectives.

Secrets are managed using tools like Kubernetes Secrets, HashiCorp Vault, AWS Secrets Manager, or Azure Key Vault. These tools securely store and manage sensitive information like API keys, passwords, and certificates, providing controlled access and auditability.

An API, or Application Programming Interface, serves as a connector between different software components or applications. It defines methods of communication among various software components and provides a set of rules or protocols for how they interact. The role of APIs in software development is crucial as they enable software systems to function together seamlessly, enabling data exchange and process integration.

Being a steward for on-call efficiency and quality of life will likely be a core responsibility for any site reliability engineer. So, for any SRE interview, it's likely you'll need to show how you would go about setting up a humane on-call experience. What can you do to improve the on-call experience? Make sure you address this question from the viewpoint that on-call isn't simply about processes and tooling — but that people need to be a core focus when setting up your on-call rotations and alert rules.

- TCP: Reliable, connection-oriented (e.g., HTTP). - UDP: Unreliable, connectionless (e.g., VoIP).

An alerting system notifies engineers of issues in real-time, enabling quick response to incidents. It is configured to trigger alerts based on predefined thresholds for critical metrics, helping in proactive monitoring and incident management.

A. Reducing Organizational Silos: - SRE treats Ops more like a software engineering problem. - DevOps focuses on both Dev and Ops departments to bridge these two worlds. B. Leveraging Tooling and Automation - SRE is focused on embracing consistent technologies and information access across the IT teams. - DevOps focuses on automation and the adoption of technology. C. Measuring Everything - DevOps is primarily focused on the process performance and results achieved with the feedback loop to realize continuous improvement. - SRE requires measurement of SLOs as the dominant metrics since the framework observes Ops problems as software engineering problems.

Capacity planning ensures that systems can handle both current and future demands by forecasting resource needs and scaling infrastructure accordingly. This proactive approach prevents performance bottlenecks and maintains system reliability.

Toil refers to manual, repetitive, automatable work that offers no long-term value and scales linearly with service growth (e.g., manual restarts, password resets). SREs aim to reduce toil by automating tasks, improving tools, and using engineering solutions. The goal is to keep operational work below 50% of an SRE's time, freeing them for project work that improves system reliability and efficiency.

Network partitioning is handled by designing systems to be partition-tolerant, implementing strategies like eventual consistency, and using consensus algorithms to maintain data integrity across partitions.

On-call rotations need to be sustainable or you'll burn out your team. In my current role, we do weekly rotations with a primary and secondary on-call. We time-box alerts—if you're getting paged every 15 minutes, that's a signal to fix the system, not a sign you're doing your job well. We also have escalation policies, so not every alert goes straight to on-call. Toil—that's the manual, repetitive work that doesn't add lasting value—is what I focus on eliminating. I track it: last quarter, we spent probably 40 hours per person per month on manual tasks. We identified the top toil items and automated them. Patching servers manually used to take 8 hours a month per person. I wrote Ansible playbooks for it, and now it's automated and takes maybe 20 minutes of oversight. Same with database backups and log rotation. The 50/50 rule—dedicating 50% of your time to projects and 50% to operations—really helps keep focus. When I see developers coming on-call for the first time, I make sure they understand what's expected and give them good runbooks. That reduces MTTR significantly because they're not guessing.

To design a system that can handle a significant traffic increase, I would first ensure that the system is horizontally scalable. This involves designing the system in a way that allows adding more servers to distribute the load. This can be complemented by vertical scaling, where we increase the resources of an existing server. I would also use load balancers to distribute network traffic evenly across servers, ensuring no single server becomes a bottleneck. Additionally, the use of caching and content delivery networks (CDN) can help reduce the load on the backend servers.

- Resource monitoring: Check Prometheus or Kubernetes metrics server for CPU, memory, and disk utilization. - Pod resource limits: Review pod resource requests and limits to ensure that they are appropriately set. Misconfigurations might lead to resource starvation or over-provisioning. - Horizontal Pod Autoscaling (HPA): Implement or adjust HPA to scale the number of pods automatically based on CPU/memory utilization. - Node autoscaling: Use Cluster Autoscaler to add new nodes automatically when resource demand increases. - Evicted pods: Check for evicted pods using `kubectl get pods --all-namespaces | grep Evicted` and investigate resource pressure. This ensures you dynamically adjust resources and avoid application downtime due to resource exhaustion.

The fundamental stages are plan (e.g., Jira), code (e.g., Git), build (e.g., Jenkins, GitLab CI), test (e.g., Selenium, JUnit), release (e.g., Spinnaker, ArgoCD), deploy (e.g., Kubernetes, Ansible), operate (e.g., Prometheus, Grafana), and monitor (e.g., ELK stack, Datadog).

The answer reveals whether you think about failure modes proactively or only reactively. Candidates who've run actual chaos experiments, Gremlin, Litmus, AWS Fault Injection Service, will describe specific experiments they've configured. Candidates who haven't will describe the concept. Interviewers can tell the difference in about thirty seconds.

Proactive monitoring aims to detect and address potential issues before they impact users, while reactive monitoring involves responding to incidents after they have occurred.

Cloud computing is a model that provides on-demand delivery of computing services over the internet. These services can include storage, databases, networking, software, and more. One of the major benefits of cloud computing is the ability to scale resources up or down quickly and efficiently, depending on the demand, which can result in cost and time savings.

A runbook provides detailed instructions for handling specific incidents or operational tasks. It helps engineers quickly respond to and resolve issues by following predefined steps, ensuring consistency and reducing the mean time to recovery (MTTR).

Answer: Cloud computing refers to the practice of storing and accessing data and applications on remote servers hosted over the internet, as opposed to local servers or the computer's hard drive. Cloud computing, often known as Internet-based computing, is a technique in which the user receives a resource as a service via the Internet. Files, pictures, papers, and other storable materials can all be considered types of data that are saved.

Error budget is the difference in performance between your SLA and SLO that allows for downtime, performance issues, and feature experimentation.

- Indexing: Add indexes to speed up query lookups. - Query Optimization: Use EXPLAIN plans to analyze and optimize slow queries. - Partitioning: Divide large tables into smaller partitions. - Caching: Use in-memory caches like Redis or Memcached to reduce load on the database. - Connection Pooling: Reuse database connections to avoid the overhead of repeatedly opening/closing them.

Situation: We had a database performance degradation affecting our checkout service. Task: I needed to update the business team on impact, timeline, and how this affected revenue. Action: Rather than diving into query optimization, I said: 'Customers are experiencing 30-second checkout delays. This is affecting conversion. We'll have it fixed in 2 hours.' I provided hourly updates. Result: Leadership stayed informed without panic, and we successfully resolved it. They later used my updates as a template for incident communication.

To minimize downtime during deployments, I advocate for strategies like blue/green deployments or canary releases to gradually expose new versions. Using feature flags allows decoupling deployment from release. Automated rollback plans are essential safeguards.

Toil refers to manual, repetitive, and automatable operational work that does not produce lasting value, such as paging, manual deployments, or routine troubleshooting. SRE teams aim to reduce toil because it consumes engineering time that could be spent on improving reliability, automation, and innovation. High toil leads to burnout, slower incident response, and reduced system reliability.

Data structure is a data organization, management, and storage format that enables efficient access and modification. More precisely, a data structure is a collection of data values, the relationships among them, and the functions or operations that can be applied to the data. The types of data structures are listed below: - Linear: Arrays, lists - Tree: Binary, heaps - Graphs: Decision, Acyclic, etc Hash: Distributed hash table, hash tree, etc

Writing actionable alerts is crucial for minimizing alert fatigue and ensuring that on-call teams respond to the right issues. Here are some best practices: - Clear and Concise Descriptions: Ensure that the alert description is clear and provides enough context to understand the issue immediately. - Severity Levels: Classify alerts with appropriate severity levels (e.g., critical, warning, info) to help prioritize the response. - Include Remediation Steps: If possible, include instructions on how to resolve the issue, reducing the time spent diagnosing the problem. - Avoid Alert Storms: Set up aggregation rules so that a single incident doesn't trigger multiple alerts. - Include Relevant Metrics: Include key performance indicators (KPIs) such as CPU utilization, memory usage, or error rates so that the issue can be identified and fixed faster. By following these practices, the team can avoid drowning in alerts and focus on resolving the most important issues.

Candidates should define toil as manual, repetitive work that scales with service growth and articulate a prioritization framework for automation efforts.

Immutable infrastructure refers to the practice of never modifying deployed servers. Instead, new servers with updated configurations or code are provisioned, and old ones are decommissioned, ensuring consistency.

- Error Budget: Use the error budget to define how much risk is acceptable for reliability versus new features. - Implement automated testing and CI/CD pipelines to reduce the impact of rapid feature releases. - Collaborate with development teams to find a balance between delivering new features and maintaining system stability.

- Elasticsearch: Search/analytics engine. - Logstash: Data processing pipeline. - Kibana: Visualization tool.

SLO is a target level of reliability for a service, usually defined by a percentage (e.g., 99.9% uptime). It is part of the Service Level Agreement (SLA) and helps in measuring service performance against the agreed standards.

Error budgets represent the allowable margin for system failures within a specific timeframe, balancing innovation and reliability. They guide decision-making on deployments and risk management, ensuring that new features are introduced without compromising system stability.

The storage units of a Linux filesystem are called inodes. An inode, which is effectively a pointer to the file's location in the filesystem, is linked to every file, subdirectory, and block device. Other attributes of inodes include their size, owner, and group IDs.

Version control helps in tracking changes to code and configurations, enabling easier rollback, collaboration, and auditability.

1. Emphasis on data to guide decisions and treating operations and software engineering problems as separate areas 2. A practice developed at Google in 2003 to reduce organizational silos 3. The cost of operational costs of software is a significant concern for many companies 4. Measuring everything is crucial to determine success in all areas

- Synchronous Replication: Writes must be confirmed on both the primary and secondary nodes before being acknowledged. This ensures data consistency but can introduce latency. It's ideal for mission-critical systems requiring strong consistency. - Asynchronous Replication: Writes are acknowledged immediately, and replication occurs later. This provides better performance but risks data loss during failures. Useful for high-performance systems where minor data loss is acceptable. - Master-Slave Replication: Writes happen on the master, and the slave only replicates data. This setup is great for read-heavy workloads. - Multi-Master Replication: Multiple nodes can handle writes, increasing availability and fault tolerance but adding complexity in conflict resolution. Good for globally distributed systems. In high-availability environments, a combination of synchronous replication for critical data and asynchronous replication for secondary services is often used.

I've primarily worked with Terraform and Ansible. In my current role, we migrated from a mix of manual AWS console clicks and shell scripts to Terraform-managed infrastructure. It was a painful process at first—about three months of work—but it was worth it. Now every infrastructure change goes through version control, gets peer-reviewed, and can be applied consistently. We reduced manual provisioning errors by probably 90%. Ansible handles the configuration management on top of that—we use it for deploying security patches and managing log rotation across our fleet. The biggest win was being able to spin up entire test environments with a single command. Before, it took hours and manual steps. Now it's automated, which means we can actually afford to test disaster recovery scenarios regularly. We also reduced our on-call wake-ups by at least 30% because we eliminated a lot of manual configuration drift issues.

RCA is a systematic process used to identify the underlying cause of an incident or problem, aiming to prevent recurrence by addressing the root issues rather than just symptoms.

- Use APM tools like New Relic, Datadog, or Jaeger to monitor performance metrics such as latency, throughput, and error rates. - Implement caching layers (e.g., Redis, Memcached) to reduce database load. - Optimize algorithms and code paths by profiling them for bottlenecks. - Horizontal scaling: Add more instances or nodes to handle increased load. - Perform load testing and benchmarking with tools like Apache JMeter or Gatling.

Eventual consistency is a consistency model in distributed systems where, given enough time, all copies of data will become consistent. It is often used in systems where high availability and partition tolerance are prioritized over immediate consistency.

Immutable infrastructure means that servers or containers are never modified after deployment; instead, they are replaced with new versions (e.g., via golden images or new containers). This eliminates configuration drift, simplifies rollbacks, and ensures consistency. Benefits include faster recovery (replace, not repair), easier automation, and improved reliability, as changes are tested in a controlled manner before full rollout.

You want to learn about how the candidate thinks about interacting with coworkers to gauge how those thoughts fit with your company's current culture as well as the culture you want in the future.

An SLO is a specific, measurable target for the performance or reliability of a service, often expressed as a percentage (like 99.9% uptime). It defines the desired quality users expect and helps measure success against an SLA.

DHCP stands for Dynamic Host Configuration Protocol. It is a protocol that allows networks to dynamically allocate IP addresses to hosts on the network. DHCP is used to assign IP addresses to devices such as PCs and routers. When a device is installed, it may need an IP address in order to access the Internet. So when a new device is installed, it will get an IP address from DHCP so that it can connect to the network. When a device connects to a network, it needs an IP address first so that it can communicate with other hosts on the network. And since most networks have only one IP address assigned for each device, there must be some mechanism for dynamically allocating those addresses. In order for a DHCP server to work, it must have at least two parts: an interface (usually Ethernet or WiFi) and some sort of database that stores information about connections and users. Since an interface is required for each device connected, this database must contain all of the information about those devices and how they are connected. All of this data is then pulled together when a connection is requested.

Docker is an open-source containerization platform by which you can pack your application and all its dependencies into a standardized unit called a container. Containers are light in weight which makes them portable and they are isolated from the underlying infrastructure and from each other container. You can run the docker image as a docker container in any machine where docker is installed without depending on the operating system. Docker is popular because of the following: - Portability. - Reproducibility. - Efficiency. - Scalability.

- Analyze slow queries using tools like EXPLAIN to identify inefficient query patterns. - Add indexes to speed up common queries, especially for large datasets. - Implement caching (e.g., Redis or Memcached) to store frequently requested data in memory. - Use read replicas to distribute the load between multiple instances. - If necessary, implement sharding to distribute data across multiple databases to avoid overloading a single instance. - Perform database maintenance (e.g., vacuum, reindex) to improve performance.

- Load Balancing: Distributes incoming traffic across multiple servers to balance load and prevent any single server from being overwhelmed. - Failover: Switches traffic to a standby server in the event of a failure.

At Google, I led an initiative to overhaul our incident management process which had a high mean time to recovery (MTTR). By introducing a new monitoring system and automating alert responses, we reduced our MTTR by 40% and improved system uptime from 95% to 99.9%. This project taught me the importance of cross-team collaboration and continuous improvement in reliability practices.

I regularly read industry blogs (e.g., Google SRE books, articles from Netflix/Spotify), attend conferences (SREcon, KubeCon), participate in online communities (Reddit r/devops, SRE mailing lists), and experiment with new tools in lab environments. I also contribute to internal knowledge sharing and encourage team members to share learnings. Continuous learning is essential in the rapidly evolving SRE landscape.

Common challenges include managing complex systems, balancing reliability with innovation, incident response, scaling infrastructure, and maintaining automation.

Disaster recovery (DR) planning is a critical part of ensuring business continuity. Here's how I approach it: - Risk Assessment: Identify potential risks and classify them based on likelihood and impact. - Backup Strategy: Ensure that backups are taken regularly, both for data and configurations. Use multi-region replication to ensure that if one data center goes down, services can fail over to another. - RTO and RPO: Define Recovery Time Objective (RTO) and Recovery Point Objective (RPO) to determine how quickly the application needs to recover and how much data loss is acceptable. - Test and Validate: Conduct regular DR drills and failover testing to ensure systems can be recovered quickly and without issues. - Automation: Use tools like Terraform or CloudFormation to automate the DR process and ensure that the application can be restored to its previous state automatically. This plan ensures that the application can withstand unforeseen failures and remain operational with minimal downtime.

`kill -15` (SIGTERM): Requests graceful shutdown. `kill -9` (SIGKILL): Forces immediate termination.

Common tools include Prometheus, Grafana, Nagios, Zabbix, Datadog, and New Relic.

MTTR is the average time to recover from a failure. To improve it, SREs focus on: faster detection (alerting, monitoring), clear incident response procedures (runbooks, escalation paths), automated remediation (self-healing scripts), better tooling (rollback mechanisms, deployment systems), and training (regular drills, chaos engineering). Reducing MTTR requires both technical improvements and organizational readiness.

Use a deque (double-ended queue) combined with a sliding window approach. Store timestamps and temperatures in a deque, maintaining it such that temperatures are in decreasing order. When a new temperature arrives: remove expired timestamps (older than 24 hours) from the front, and remove temperatures from the back that are less than or equal to the new temperature to maintain order. The max is always at the front. This gives O(1) amortized time for each operation.

I am motivated by the challenge of ensuring large-scale systems are reliable, scalable, and resilient. SRE combines my interest in software engineering with operational problem-solving, allowing me to build automation that reduces manual work and improves system health. The focus on measurable outcomes, like SLOs and error budgets, appeals to my data-driven mindset. I also value the collaborative culture of SRE teams, where blameless postmortems and continuous improvement drive real impact.

The shell parses the command and calls fork() to create a child process. The child uses execve() to load the ls binary. The kernel loads the executable, sets up memory segments, and starts execution. ls -l makes system calls like open(), read(), and getdents() to read directory contents, then stat() for file metadata. Results are written to stdout via write().

- Deploy a new version of your application in a parallel environment (blue and green clusters). - Switch traffic using Kubernetes Ingress or Service objects to route traffic between the old (blue) and new (green) environments. - After testing and validation, fully migrate traffic to the green environment and decommission the blue.

- Use CDNs and WAFs: Implement a Content Delivery Network (CDN) and Web Application Firewall (WAF) to filter and block malicious traffic before it reaches the application. - Rate limiting: Configure rate limiting at the load balancer or API gateway to prevent excessive requests from overwhelming the system. - Auto-scaling: Enable auto-scaling in your cloud environment to absorb traffic spikes and mitigate potential outages during an attack. - Network filtering: Use network security groups or firewalls to block known bad IPs or geographic locations contributing to the DDoS attack. - DDoS protection services: Use cloud-native DDoS protection services like AWS Shield, Azure DDoS Protection, or Cloudflare to mitigate large-scale attacks. These strategies reduce the impact of DDoS attacks and ensure your system remains available even during hostile traffic surges.

- Avoid running Docker containers with root permissions - While this may make dealing with permission management easier, you open up the container to risk. - Use secure container registries - Utilizing secure registries like Docker Trusted Registry helps prevent potential security risks. - Limit container resource usage - This helps prevent attacks on your systems from resource exhaustion from those looking to disrupt your service. - Scan images - Scanning images regularly for vulnerabilities helps prevent security risks. Tools like Snyk can help with automated container scanning. - Monitor containers - Utilize monitoring tools like (Prometheus or Datadog) to monitor your containers, gaining visibility and observability.

To investigate, I would analyze latency metrics broken down by request type, endpoint, and region. I would check resource utilization (CPU, memory, I/O) and database query performance. I would also review recent changes and traffic patterns. Mitigation steps could include scaling up resources (e.g., horizontal scaling of instances), optimizing database queries, adding caching, or implementing rate limiting. If the issue is persistent, I would redesign the architecture to handle peak loads, such as using autoscaling or sharding.

DevOps is a set of practices and guidelines that aim to break down silos between development and operations, focusing on five key areas: collaboration, risk mitigation, smaller changes, human error removal, and measurement.

This question tests the candidate's knowledge about setting up monitoring and alerting tools and how you've helped define a system's 'healthy' state in the past. This is essential as being part of an SRE team; you need to explain how you can leverage internal and external outputs to determine overall system health, translating into actionable insights for the teams.

The three pillars are logs (detailed records of events), metrics (numeric measurements over time), and traces (end-to-end request paths across services). Together they provide insight into system behavior and enable debugging.

Effective answers show prioritization frameworks and boundary-setting skills that prevent operational demands from consuming all available time.

A bootloader known as LILO (Linux Loader) is used to load Linux into memory and launch the operating system. Due to its ability to support dual booting, it is also referred to as a boot manager.

Situation: I accidentally deployed an incomplete database migration to production during a Friday afternoon. Task: This broke a critical data pipeline affecting our data team's weekend analysis. Action: I immediately notified my manager and the affected team, started a war room, and worked on rolling back safely. Rollback itself took 30 minutes. I stayed on-call through the weekend to monitor for issues. We did a blameless post-mortem and identified that our deployment checklist didn't require verification that migrations were complete. Result: We now have a pre-deployment verification step, and I'm more cautious about Friday deployments. I also learned to ask for code review from someone senior when I'm tired or stressed, not to push through.

Check system resource usage with top, htop, or vmstat. Use iostat for disk I/O, netstat or ss for network connections. Analyze web server logs for slow requests. Profile with strace or perf to identify system call bottlenecks. Use tools like ab or wrk for load testing. Check database query performance with slow query logs. Optimize by caching, increasing resources, or tuning configuration.

- Distributed log collection: Use agents like Fluentd or Logstash on each node to collect logs and send them to a central logging system. - Message queues: Implement a message queue like Kafka or AWS Kinesis to handle high log throughput and act as a buffer. - Distributed storage: Store logs in distributed, scalable storage systems like Elasticsearch, S3, or Google BigQuery. - Horizontal scaling: Ensure the logging system components (e.g., Logstash, Elasticsearch nodes) can scale horizontally to accommodate increased log volumes. - Retention policies: Implement log retention and archival policies to avoid overwhelming storage capacity. - Real-time analytics: Use Kibana, Grafana, or Graylog to provide real-time log search, dashboards, and alerts.

- Logging - captures detailed records of events within a system, which is useful for diagnosing specific issues. - Monitoring - continuously tracks system metrics for real-time health and performance insights. - Tracing - follows the flow of requests through a system to pinpoint bottlenecks and understand interactions.

Situation: A developer wanted to deploy a major feature change without a canary deployment. Our latency was already high, and I was concerned about customer impact. Task: I needed to either convince them to canary or understand why they felt confident in a full rollout. Action: I asked questions rather than saying no: 'Walk me through your testing. What's our rollback plan? What's the risk if this causes a 10% latency increase?' We looked at error budget—we didn't have much margin. We compromised: 10% canary for 30 minutes, then gradual rollout if metrics looked good. Result: We caught a subtle performance regression in the canary that wouldn't have been caught in testing. It reinforced why we have these processes. The developer respected the rigor after seeing it work.

By considering the budget and ensuring that everyone is aware of the steps involved in the change management process, organizations can ensure that they are using their resources effectively and efficiently.

Persistent storage for containers (e.g., databases).

Answer: The Dynamic Host Configuration Protocol, or DHCP for short, is a protocol that allows IP addresses to be distributed throughout a network quickly, automatically, and centrally. Additionally, it is used to set up the device's DNS server details, default gateway, and subnet mask. It's used to automatically request networking settings and IP addresses from the Internet service provider (ISP). Also, the requirement for manual IP address assignment to all network devices by users or network administrators is lowered.

A thundering herd occurs when many clients or processes simultaneously retry or connect after a failure, overwhelming the system. Solutions include: using exponential backoff with jitter in retry logic, implementing request coalescing, using a cache or queue to buffer requests, and setting connection limits. SREs design clients to spread retries randomly to prevent synchronized spikes.

The Service Risk (S.R.) approach is a DevOps practice that focuses on building scale and more reliable software. It involves getting the architecture of the system and working between the development and engineering teams. It is also a jump function as a dimension, aiming for the best but planning for the worst.

- Use a centralized logging solution like the ELK Stack (Elasticsearch, Logstash, Kibana), Graylog, or Fluentd to collect logs from distributed systems. - Implement log forwarding agents on each node to send logs to the centralized platform. - Apply log rotation and retention policies to manage the storage of logs and avoid running out of disk space. - Use log analytics tools to search, filter, and visualize logs to identify and troubleshoot issues. - Tag logs with metadata (e.g., service name, instance ID) to easily identify the source of issues in complex, distributed environments.

Automatically adjusts EC2 instances based on demand (e.g., CPU utilization).