Newsletter

    Subscribe our newsletter

    Get new infrastructure guides, comparison reports, and migration notes in your inbox.

    Infrastructure notes, guides, and new tools. Unsubscribe anytime.

    Back to Blog
    AI Operations
    Monitoring
    AIOps

    How can natural language be used to query infrastructure monitoring and operations data?

    August 8, 2026
    9 min read read

    Natural language can be used as a front end for infrastructure monitoring and operations data by converting an operator's question into structured queries against time-series, consumption, inventory, alarm, and relationship data. The answer should then return the result in a readable form and show where the data came from, what metric was used, what time range was scanned, and how the result was calculated.

    The useful idea is simple: the operator asks the operational question directly instead of first deciding which dashboard, metric, filter, or report to open. The underlying monitoring system still provides the data. Natural language changes how the user reaches it.

    What does a natural-language operations query actually do?

    A natural-language operations query translates an operator's request into one or more machine-readable requests against operational data.

    The source operations-assistant design gives a concrete example:

    "Which nodes exceeded 90% utilization in the last 24 hours and what tasks were running on them?"

    That one sentence contains several pieces of query intent.

    The user wants nodes.

    The metric is utilization.

    The threshold is 90%.

    The time window is the last 24 hours.

    The answer also needs workload or task relationships.

    A useful assistant has to identify those elements, query the monitoring and consumption data, join the relevant relationships, and return a structured result.

    The natural-language layer does not replace the monitoring platform. It turns an operations question into a monitoring request.

    What kinds of infrastructure data can be queried this way?

    The source design supports natural-language access to monitoring, consumption, configuration, alarm, and operations knowledge.

    That makes several query types possible.

    Resource state:

    Which nodes are unhealthy?

    Which accelerator cards are degraded?

    Which racks are near their power threshold?

    Utilization:

    Which nodes exceeded a defined utilization level?

    Which accelerator resources have been idle for a specified period?

    Which projects are consuming the most compute?

    Operations:

    Which alarms are still open?

    Which work orders relate to this device?

    What happened during the previous incident on this server?

    Capacity:

    When will the current resource pool reach a defined allocation threshold?

    Where is resource fragmentation preventing jobs from starting?

    Knowledge:

    What does this architecture component do?

    Which runbook applies to this type of incident?

    The value comes from bringing different operational data types behind one conversational entry point.

    Why is this better than asking users to know metric names?

    Operators usually think in operational questions, not in internal metric identifiers.

    A duty engineer may know that a workload is slow without knowing the exact name of the storage-throughput metric.

    A manager may want to know when capacity will become constrained without knowing which resource-allocation table drives the forecast.

    A natural-language layer can translate those questions into the correct operational queries.

    That reduces the need for every user to memorize:

    Metric names
    Dashboard locations
    Filter syntax
    Object identifiers
    Report definitions

    The source design positions the assistant as the place for asking while the operations cockpit remains the place for looking.

    Both interfaces use the same underlying data.

    How should the assistant translate a question into data requests?

    The translation should identify the object, metric, condition, time range, grouping, and relationship requested by the user.

    Consider:

    "Which GPU nodes had utilization above 90% yesterday and what projects were using them?"

    The assistant needs to resolve:

    Object: GPU nodes
    Metric: utilization
    Condition: above 90%
    Time: yesterday
    Relationship: node to task or workload, then workload to project
    Output: qualifying nodes and their project context

    A different question might ask:

    "Which services could move from full-card allocation to shared resources?"

    That requires a different data path.

    The assistant needs resource-allocation history, utilization behavior, resource specification, and the policy used to identify possible fragmentation or over-allocation.

    The source model explicitly includes fragmentation identification and optimization recommendations as assistant capabilities.

    The main requirement is that the conversion be accurate enough that the final answer corresponds to the user's actual intent.

    Why does CMDB relationship data matter?

    Natural-language operations questions often require relationships, not only metrics.

    A monitoring database can tell you that Node A had high utilization.

    The user may also ask which workload was running, which project owns it, or which business service depends on it.

    Those answers require the relationship-data foundation.

    The source platform connects:

    Tasks to containers
    Containers to GPUs
    GPUs to physical nodes
    Nodes to network and storage
    Services to projects and owners

    That allows one natural-language question to move across several operational layers.

    For the relationship model itself, how a CMDB can connect servers, GPUs, containers, applications, business services, and owners explains how those links support operations.

    How should time ranges be handled?

    The assistant should resolve the requested time period explicitly and use the same period across related data sources.

    Examples include:

    Last 15 minutes
    Last 24 hours
    Yesterday
    This week
    The period of Incident 1842

    If the user asks about utilization and workload assignment over the same 24-hour window, both datasets need to be evaluated consistently.

    The source assistant design also emphasizes statistical-definition attribution.

    That matters because "utilization above 90%" can mean several things.

    Maximum utilization crossed 90%.

    Average utilization remained above 90%.

    A 95th percentile exceeded 90%.

    The answer should state which interpretation it used.

    Do not hide statistical meaning behind natural language.

    What source attribution should be shown?

    Every operational answer should make the source visible enough to verify.

    The source design explicitly calls for data-source attribution, metric names, statistical definitions, scan scope, and data granularity.

    A useful answer can say:

    Data source: node utilization telemetry
    Metric: accelerator utilization
    Time range: previous 24 hours
    Aggregation: five-minute average
    Scan scope: 62 online nodes
    Relationship source: task and project bindings

    The exact display can be compact.

    The principle is that the operator should be able to understand how the answer was produced.

    This is especially important for forecasts and recommendations.

    If an assistant says capacity will reach a threshold in 23 days, the user should be able to see the data and assumptions behind that estimate.

    How can natural language be used for incident troubleshooting?

    The assistant can combine live operational data with historical operational knowledge.

    The source knowledge base includes:

    Work orders
    Alarm events
    Architecture documents
    Emergency runbooks

    Those items are ingested and vectorized together.

    That allows the user to ask a question such as:

    "Why is this node unhealthy, and have we seen this before?"

    The assistant can use the active monitoring data for the current condition and retrieve previous work orders for similar incidents.

    It can then show:

    Current alarm
    Likely cause or investigation path
    Historical incident
    Relevant runbook
    Recommended next check

    For the broader assistant design, how AI assistants use alarms, work orders, runbooks, and infrastructure documents explains how live queries and knowledge retrieval work together.

    How can natural language support capacity forecasting?

    The source assistant includes capacity forecasting and expiry-risk reminders.

    A user can ask:

    "When will this resource pool reach 90% allocation?"

    The assistant can retrieve the historical allocation trend and apply the platform's forecasting logic.

    The result should remain traceable.

    It should show:

    Current allocation
    Trend window
    Threshold
    Forecast date or interval
    Data source

    The same interface can answer questions about fragmentation.

    For example:

    "Why are jobs waiting when GPUs are free?"

    The assistant can inspect the requested resource shape, available devices, topology, and scheduling state, then explain whether the issue is quota, fragmentation, health exclusion, or another known condition.

    How can natural language query business consumption?

    The same approach can query metering data.

    Examples:

    Which project consumed the most accelerator card hours this month?

    Which model produced the most Tokens today?

    Which tenant has the highest idle allocation?

    Which accelerator type has the highest unit cost?

    The source platform allocates consumption across project, tenant, model, and accelerator type.

    That gives the assistant stable dimensions to query.

    A user does not need to open the cost dashboard first.

    They can ask the question and receive the relevant grouped result.

    The result should still use the same definitions as the formal metering dashboard.

    Natural language should not create a second version of the numbers.

    How should the assistant handle ambiguous questions?

    It should resolve the ambiguity from available context when the operational model provides enough information, and make the chosen interpretation visible.

    For example:

    "Show me overloaded nodes."

    The platform needs a definition of overloaded.

    If the operations policy defines overloaded as sustained utilization above a specific threshold, the assistant can use that rule and state it.

    If no definition exists, the source materials do not specify a universal threshold. In that case, the assistant should not invent one.

    It can ask for a threshold or present available utilization data without labeling it overloaded.

    The same principle applies to terms such as "expensive," "unhealthy," or "high risk."

    Operational language should map to defined platform rules where they exist.

    What should happen when the requested data is unavailable?

    The assistant should say it cannot retrieve the requested data.

    The source assistant design makes this a hard rule.

    Missing data must not be filled with a plausible answer.

    There are several reasons a query may fail.

    The metric is not collected.

    The requested time range is outside retention.

    The user lacks permission.

    The relationship is missing.

    The data source is currently unavailable.

    The assistant should distinguish those cases when the platform can identify them.

    An explicit "data unavailable" response is operationally safer than a confident estimate with no evidence.

    How should permissions apply to natural-language queries?

    Natural-language access should use the same organization, role, tenant, project, and least-privilege controls as the rest of the platform.

    The source governance design includes:

    Department and team hierarchy
    Role permission matrix
    Tenant membership
    Project membership
    Least privilege
    Separate authorization for sensitive operations

    The assistant should inherit those controls.

    A user who cannot open Project B's monitoring data through the normal interface should not be able to retrieve it by asking a conversational question.

    The natural-language layer is another interface to the same operational data, not a permission bypass.

    Can a natural-language query trigger a change?

    The source design keeps a clear execution boundary.

    The assistant can analyze and recommend.

    Change actions still require workflow approval before execution.

    That means a user can ask:

    "Which degraded nodes should be removed from the pool?"

    The assistant can return the candidates and evidence.

    If the user then wants to execute the change, the action should enter the normal authorization process.

    For the governance model, how enterprises automate data center operations while keeping approvals, permissions, rollback, and audit controls explains how recommendation and execution stay connected without removing control.

    What makes a natural-language operations interface trustworthy?

    Three things matter most.

    The answer must come from the real operations data.

    The reasoning path must be visible enough to verify.

    The assistant must stay inside its permissions and execution boundary.

    A platform example that uses natural-language-to-monitoring query conversion with source attribution is Sensaka.

    If I were evaluating this capability, I would test questions that require several data sources at once. Ask which nodes exceeded a utilization threshold, what workloads were running, which projects owned them, and whether any related incidents existed. If the assistant can return the correct result with explicit data sources and time scope, natural-language operations querying is doing useful work rather than simply paraphrasing dashboards.

    Frequently Asked Questions

    What can an IT operations team ask in natural language?

    Teams can ask about resource utilization, abnormal nodes, active workloads, capacity trends, fragmentation, alarms, architecture, and previous incidents when those data sources are connected to the assistant.

    How should an AI assistant answer a monitoring-data question?

    It should convert the question into a query against the relevant operational data, return a structured result, and show the data source, metric definition, time range, scan scope, and data granularity.

    What should happen if the requested operations data cannot be retrieved?

    The assistant should say that the data is unavailable instead of inventing an answer. Operational recommendations should remain traceable to retrieved data, documents, alarms, or work orders.