Compare commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
93828b38e9 | ||
|
|
178a03e898 | ||
|
|
7c917969d8 | ||
|
|
051e70b82b | ||
|
|
d6263049ef | ||
|
|
bdcfb76c25 | ||
|
|
e32499b7f6 | ||
|
|
e1716d5228 | ||
|
|
4a1998046b | ||
|
|
fed279a0bd | ||
|
|
e0ff3e2168 |
No files matched your search
@@ -0,0 +1,21 @@
|
||||
MIT License
|
||||
|
||||
Copyright (c) 2025-2026 Jared Vititoe
|
||||
|
||||
Permission is hereby granted, free of charge, to any person obtaining a copy
|
||||
of this software and associated documentation files (the "Software"), to deal
|
||||
in the Software without restriction, including without limitation the rights
|
||||
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
||||
copies of the Software, and to permit persons to whom the Software is
|
||||
furnished to do so, subject to the following conditions:
|
||||
|
||||
The above copyright notice and this permission notice shall be included in all
|
||||
copies or substantial portions of the Software.
|
||||
|
||||
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
||||
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
||||
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
||||
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
||||
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
||||
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
||||
SOFTWARE.
|
||||
@@ -11,6 +11,42 @@ Deployed on **LXC 157** (monitor-02 / 10.10.10.9), reachable at `gandalf.lotusgu
|
||||
|
||||
**Design System**: [web_template](https://code.lotusguild.org/LotusGuild/web_template) — shared CSS, JS, and layout patterns for all LotusGuild apps
|
||||
|
||||

|
||||
|
||||
## Why this exists
|
||||
|
||||
A Proxmox/Ceph cluster lives or dies by its network, and network problems are sneaky: a link that flaps, a fibre with weak receive power, a switch port that quietly negotiated 1 Gbps. GANDALF watches the cluster's links from three angles at once (host NIC state from Prometheus, switch ports and LLDP from the UniFi controller, and reachability pings), alerts only on **regressions** (a link that was up and went down; ports that were never connected are learned as baseline and ignored), and files one ticket per real problem. When something looks wrong, a click on the switch port runs a full on-host diagnostic through [PULSE](https://code.lotusguild.org/LotusGuild/pulse) (`ethtool`, SFP optics, kernel log, LLDP) and explains what it found.
|
||||
|
||||
## Gallery
|
||||
|
||||
**Dashboard**: alert queue with linked tickets, a live topology, per-host interface status and the UniFi device inventory.
|
||||
|
||||

|
||||
|
||||

|
||||
|
||||

|
||||
|
||||
**Device pages**: search by hostname, IP, MAC, model or interface from the dashboard, then open one page per host, switch, router, PDU or modem. Each interface or port is one row with its state, speed, traffic and neighbour. Expanding a row shows duplex, carrier flaps, error and drop rates, PoE, LLDP, and **SFP optical readings** (temperature, TX/RX power) with colour-coded thresholds.
|
||||
|
||||
**Port inspector**: each switch and router page has a front-panel diagram. Click a port for its stats, LLDP neighbour and a side-by-side switch/server path check.
|
||||
|
||||

|
||||
|
||||
**One-click diagnostics**: GANDALF asks a PULSE worker to SSH to the host on the other end of the link and collect everything in one pass, then analyzes it: carrier, duplex and speed mismatches, SFP power levels, CRC errors, link flaps, recent kernel events and LLDP validation.
|
||||
|
||||

|
||||
|
||||
**Suppressions**: timed or manual maintenance windows per host, interface or UniFi device, with a full history.
|
||||
|
||||

|
||||
|
||||
**Light theme:**
|
||||
|
||||

|
||||
|
||||
<sub>Screenshots come from a throwaway local instance seeded with fictional data (documentation IP ranges), with PULSE replaced by a small mock. See `scripts/demo/`.</sub>
|
||||
|
||||
## Styling & Layout
|
||||
|
||||
GANDALF uses the **LotusGuild Terminal Design System**. For all styling, component, and layout documentation see:
|
||||
@@ -37,6 +73,7 @@ Two processes share a MariaDB database:
|
||||
[UniFi Controller] ──▶ monitor.py ──▶ MariaDB ◀── app.py ──▶ nginx ──▶ Authelia ──▶ Browser
|
||||
[Pulse Worker] ──▶
|
||||
[SSH / ethtool] ──▶
|
||||
[AT&T BGW320] ──▶
|
||||
```
|
||||
|
||||
### Data Sources
|
||||
@@ -47,6 +84,7 @@ Two processes share a MariaDB database:
|
||||
| **UniFi API** (`https://10.10.10.1`) | Switch port stats, device status, LLDP neighbor table, PoE data |
|
||||
| **Pulse Worker** | SSH relay — runs `ethtool` + SFP DOM queries on each Proxmox host |
|
||||
| **Ping** | Reachability for hosts without `node_exporter` (e.g. PBS) |
|
||||
| **AT&T BGW320** (`http://192.168.1.254`) | Fiber light levels, PON and WAN state, WAN counters, scraped read-only from the gateway's status pages (no login) |
|
||||
|
||||
### Monitored Hosts (Prometheus / node_exporter)
|
||||
|
||||
@@ -66,35 +104,40 @@ Ping-only (no node_exporter): **pbs** (10.10.10.3)
|
||||
## Pages
|
||||
|
||||
### Dashboard (`/`)
|
||||
- Device search (see Device pages below)
|
||||
- Active alerts first, then the WAN / Fiber panel, hosts, UniFi devices, topology, and recently resolved alerts
|
||||
- Real-time host status grid with per-NIC link state (UP / DOWN / degraded)
|
||||
- Network topology diagram (Internet → Gateway → Switches → Hosts)
|
||||
- Network topology diagram (Internet → Modem → Gateway → Switches → Hosts)
|
||||
- WAN / Fiber panel: WAN and PON state, Rx/Tx power, optics temperature, throughput, errors, gateway uptime and last restart, 7-day Rx trend, recent WAN outages
|
||||
- UniFi device table (switches, APs, gateway)
|
||||
- Active alerts table with severity, target, consecutive failures, ticket link
|
||||
- Quick-suppress modal: apply timed or manual suppression from any alert row
|
||||
- Auto-refreshes every 30 seconds via `/api/status` + `/api/network`
|
||||
|
||||
### Link Debug (`/links`)
|
||||
Per-interface statistics collected every poll cycle. All panels are collapsible
|
||||
(click header or use Collapse All / Expand All). Collapse state persists across
|
||||
page refreshes via `sessionStorage`.
|
||||
### Device pages (`/device/<name>`)
|
||||
One page per host, switch, router, AP, PDU, or modem. Reach them from the search box on the
|
||||
dashboard (`/` focuses it), or from any device name. Search matches hostname, IP, MAC, model, type,
|
||||
interface and port names, and LLDP neighbors.
|
||||
|
||||
**Server NICs** (via Prometheus + SSH/ethtool):
|
||||
- Speed, duplex, auto-negotiation, link detected
|
||||
- TX/RX rate bars (bandwidth utilisation % of link capacity)
|
||||
- TX/RX error and drop rates per second
|
||||
- Carrier changes (cumulative since boot — watch for flapping)
|
||||
- **SFP / Optical panel** (when SFP module present): vendor/PN, temp, voltage,
|
||||
bias current, TX power (dBm), RX power (dBm), RX−TX delta, per-stat bars
|
||||
- **Overview**: status, IP, MAC, model, firmware, uptime, CPU, memory, clients, temperatures, power draw
|
||||
- **Alerts**: active and past alerts for this device
|
||||
- **WAN** (routers): connection state, speed, latency, availability
|
||||
- **Connected to** (hosts): switch ports that see this host over LLDP
|
||||
- **Outlets** (PDUs): per-outlet state, power, and auto power-cycle setting
|
||||
- **Port inspector** (switches, routers): see below
|
||||
- **Interfaces / Ports**: one row each with state, speed, RX/TX rate, and neighbor, filterable.
|
||||
Expanding a host's row shows duplex, auto-negotiation, carrier changes, error and drop rates,
|
||||
traffic bars, PoE, LLDP detail, and the **SFP / optical panel** (vendor/PN, temperature, voltage,
|
||||
bias, TX/RX power, RX−TX delta)
|
||||
- **WAN / Fiber** (modem): the same panel as the dashboard
|
||||
|
||||
**UniFi Switch Ports** (via UniFi API):
|
||||
- Port number badge (`#N`), UPLINK badge, PoE draw badge
|
||||
- LLDP neighbor line: `→ system_name (port_id)` when neighbor is detected
|
||||
- PoE class and max wattage line
|
||||
- Speed, duplex, auto-neg, TX/RX rates, errors, drops
|
||||
These replaced the Link Debug page; `/links` now redirects to the dashboard. Hosts that Prometheus
|
||||
sees but `config.json` doesn't list still get a page, with their state shown as unknown because
|
||||
they aren't alerted on.
|
||||
|
||||
### Inspector (`/inspector`)
|
||||
Visual switch chassis diagrams. Each switch is rendered model-accurately using
|
||||
layout config in the template (`SWITCH_LAYOUTS`).
|
||||
### Port inspector (on switch and router device pages)
|
||||
A realistic front panel, drawn as SVG from the model's real geometry in `static/faceplates.js`
|
||||
(`FACEPLATES`). `/inspector` now redirects to the dashboard. Link to a port with `/device/<name>#port-<n>`.
|
||||
|
||||
**Port block colours:**
|
||||
| Colour | State |
|
||||
@@ -105,7 +148,7 @@ layout config in the template (`SWITCH_LAYOUTS`).
|
||||
| Grey | Down |
|
||||
| White outline | Currently selected |
|
||||
|
||||
**Clicking a port** opens the right-side detail panel showing:
|
||||
**Clicking a port**, on the panel or in the port table, opens the detail panel showing:
|
||||
- Link stats (status, speed, duplex, auto-neg, media type)
|
||||
- PoE (class, max wattage, current draw, mode)
|
||||
- Traffic (TX/RX rates)
|
||||
@@ -115,23 +158,30 @@ layout config in the template (`SWITCH_LAYOUTS`).
|
||||
two-column comparison of the switch port stats vs. the server NIC stats,
|
||||
including SFP DOM data if the server side has an SFP module
|
||||
|
||||
**LLDP path debug requirements:**
|
||||
1. Server must run `lldpd`: `apt install lldpd && systemctl enable --now lldpd`
|
||||
2. `lldpd` hostname must match the key in `data.hosts` (set via `config.json → hosts`)
|
||||
3. Switch has LLDP enabled (UniFi default: on)
|
||||
**Port neighbors**: UniFi's LLDP data identifies a neighbor only by MAC, so Gandalf names it by matching that MAC
|
||||
against host NICs (`node_network_info` from node_exporter) and UniFi devices, then falling back to management IPs.
|
||||
Servers that don't send LLDP are found through UniFi's wired client table. Uplink ports are skipped there, and
|
||||
neighbors that can't be matched show their MAC. Bonded NICs share a MAC, so only one member's port may be identified.
|
||||
|
||||
**Supported switch models** (set `SWITCH_LAYOUTS` keys to your UniFi model codes):
|
||||
**Path check and diagnostics requirements:**
|
||||
1. The server's node_exporter is scraped, so its NIC MACs are in Prometheus
|
||||
2. The Pulse worker can SSH to the server
|
||||
3. Optional: `lldpd` on the server lets diagnostics confirm the cabling from the server's side
|
||||
|
||||
| Key | Model | Layout |
|
||||
**Supported models** (keys are UniFi model codes):
|
||||
|
||||
| Key | Model | Front panel |
|
||||
|---|---|---|
|
||||
| `USF5P` | UniFi Switch Flex 5 PoE | 4×RJ45 + 1×SFP uplink |
|
||||
| `USL8A` | UniFi Switch Lite 8 PoE | 8×SFP (2 rows of 4) |
|
||||
| `US24PRO` | UniFi Switch Pro 24 | 24×RJ45 staggered + 2×SFP |
|
||||
| `USPPDUP` | Custom/other | Single-port fallback |
|
||||
| `USMINI` | UniFi Switch Mini | 5-port row |
|
||||
| `UDMPRO` | Dream Machine Pro | 8×RJ45 LAN, RJ45 WAN, SFP+ WAN, SFP+ LAN, screen, drive bay |
|
||||
| `US24PRO` | USW Pro 24 PoE | 24×RJ45 in two blocks of 12, 2×SFP+ |
|
||||
| `USL8A` | USW Aggregation | 8×SFP+ in four stacked pairs |
|
||||
| `USF5P` | USW Flex | 5×RJ45, PoE in on port 1, PoE out on 2-5 |
|
||||
| `USMINI` | USW Flex Mini | 5×RJ45, PoE in on port 1 |
|
||||
| `USPPDUP` | USP PDU Pro | 20 outlets (4 USB-C, 16 AC), management port 21, surge pass-through ports 22-23 |
|
||||
| `USPDA2B` | UPS 2U Pro | Front with touchscreen outlet tiles; rear with 8 outlets, EPO, surge and MGMT ports |
|
||||
|
||||
Add new layouts by adding a key to `SWITCH_LAYOUTS` matching the `model` field
|
||||
returned by the UniFi API for that device.
|
||||
Port LEDs use the colors from each model's quick start guide. Other models use plain blocks until they get an
|
||||
entry in `FACEPLATES`.
|
||||
|
||||
### Suppressions (`/suppressions`)
|
||||
- Create timed (30 min / 1 hr / 4 hr / 8 hr) or manual suppressions
|
||||
@@ -150,8 +200,33 @@ returned by the UniFi API for that device.
|
||||
|---|---|
|
||||
| UniFi device offline (≥`unifi_failure_threshold` consecutive checks) | P2 High |
|
||||
| Proxmox host NIC link-down regression (≥2 consecutive checks) | P2 High |
|
||||
| Host unreachable via ping (≥2 consecutive checks) | P2 High |
|
||||
| ≥3 hosts simultaneously reporting interface failures | P1 Critical |
|
||||
| Host unreachable via ping (≥`host_failure_threshold` consecutive checks) | P2 High |
|
||||
| Configured host has no metrics in Prometheus (host or `node_exporter` down, ≥`host_failure_threshold` consecutive checks) | P2 High |
|
||||
| Prometheus unavailable, so host and interface alerting is paused (≥2 consecutive checks) | P2 High |
|
||||
| ≥3 hosts simultaneously reporting interface or metrics failures | P1 Critical |
|
||||
| WAN down: broadband or optical status not Up, or PON not in O5 (≥`modem.failure_threshold`) | P1 Critical |
|
||||
| Modem not responding (≥`modem.failure_threshold`) | P2 High |
|
||||
| Fiber Rx/Tx power or optics temperature in the module's alarm range, or a supply voltage or Tx bias alarm flag (≥`modem.failure_threshold`) | P2 High |
|
||||
| Fiber reading in the module's warning range (≥`modem.failure_threshold`) | P3 |
|
||||
| Rx power `rx_drift_db` or more below its 7-day median (≥`modem.failure_threshold`) | P3 |
|
||||
| Modem pages unreadable, e.g. after a firmware update (≥`modem.failure_threshold`) | P3 |
|
||||
| UniFi logs that Smart Power auto power-cycled the modem | P3 |
|
||||
| UniFi logs that the WAN failed multiple times in 24 hours (at most one ticket a day) | P2 |
|
||||
|
||||
A failed Pulse ping check counts as "unknown": it neither raises nor resolves `host_unreachable`.
|
||||
|
||||
### WAN modem notes
|
||||
|
||||
The alarm and warning limits are read from the gateway on every poll, so they are never hard-coded here.
|
||||
Those limits are wide (warning at -27.9 dBm on a link that normally sits near -17), so `fiber_rx_drift`
|
||||
compares each reading to the link's own 7-day median to catch a damaged connector earlier. It stays quiet
|
||||
until `rx_drift_min_samples` readings exist (about a day at a 5 minute poll).
|
||||
|
||||
Outages can be over between polls: two real ones lasted about two minutes against a 5 minute poll.
|
||||
So WAN outages and modem restarts also come from the UniFi system log, and a drop in the modem's uptime
|
||||
records a restart even if nothing logged it. A single short outage only appears in the panel's history.
|
||||
|
||||
To silence modem alerts during maintenance, create a `host` suppression with the modem's `name`.
|
||||
|
||||
### Baseline Tracking
|
||||
|
||||
@@ -218,11 +293,16 @@ Shared by both processes. Located in the working directory (`/var/www/html/prod/
|
||||
"monitor": {
|
||||
"poll_interval": 120,
|
||||
"failure_threshold": 2,
|
||||
"host_failure_threshold": 5,
|
||||
"unifi_failure_threshold": 5,
|
||||
"cluster_threshold": 3,
|
||||
"ping_hosts": [
|
||||
{ "name": "pbs", "ip": "10.10.10.3" }
|
||||
]
|
||||
},
|
||||
"modem": {
|
||||
"url": "http://192.168.1.254",
|
||||
"name": "att-modem"
|
||||
}
|
||||
}
|
||||
```
|
||||
@@ -244,9 +324,16 @@ Shared by both processes. Located in the working directory (`/var/www/html/prod/
|
||||
| `hosts` | Maps Prometheus instance labels → display hostnames |
|
||||
| `monitor.poll_interval` | Seconds between full check cycles (default: 120) |
|
||||
| `monitor.failure_threshold` | Consecutive failures before creating ticket (default: 2) |
|
||||
| `monitor.host_failure_threshold` | Consecutive failures before ticketing a host that has disappeared, whether it has no metrics or doesn't answer ping (default: 5). A normal reboot takes about 3-5 minutes, so the default rides it out: the host still shows as down on the dashboard, but a ticket opens only after about 8 minutes at the default poll interval. For longer maintenance, suppress the host first. |
|
||||
| `monitor.unifi_failure_threshold` | Consecutive failures before ticketing a UniFi device as offline (default: same as `failure_threshold`). Set higher than `failure_threshold` — UniFi switches/APs can take several minutes to rejoin after a firmware-update reboot, so a low threshold cuts tickets for momentary maintenance reboots instead of real failures. |
|
||||
| `monitor.cluster_threshold` | Hosts with failures to trigger cluster-wide P1 (default: 3) |
|
||||
| `monitor.ping_hosts` | Hosts checked only by ping (no node_exporter) |
|
||||
| `modem.url` | AT&T gateway base URL. Omit the `modem` block to disable modem monitoring. Must be reachable from the monitor host. |
|
||||
| `modem.name` | Name used for the modem's alerts, tickets, and suppressions (default: `att-modem`) |
|
||||
| `modem.timeout` | Seconds to wait per status page (default: 10) |
|
||||
| `modem.failure_threshold` | Consecutive failures before ticketing a modem alert (default: same as `failure_threshold`). Raise it if gateway reboots or automatic firmware updates cut tickets. |
|
||||
| `modem.rx_drift_db` | Rx drop below the 7-day median that raises `fiber_rx_drift` (default: 3.0) |
|
||||
| `modem.rx_drift_min_samples` | Readings required before drift alerts start (default: 288) |
|
||||
|
||||
---
|
||||
|
||||
@@ -363,32 +450,42 @@ systemctl restart gandalf gandalf-monitor
|
||||
|
||||
## Troubleshooting
|
||||
|
||||
### Avatar photo missing (`/api/avatar` returns 404)
|
||||
`journalctl -u gandalf | grep -i avatar` gives the reason: `no ldap.host / ldap.bind_dn` (missing config),
|
||||
`ldap3 not installed` (run `pip3 install -r requirements.txt`), `LDAP avatar lookup failed` (bind or network),
|
||||
`LDAP has no photo` (or `Remote-User` doesn't match a uid), or a cached `no photo` marker, which expires
|
||||
after `ldap.cache_ttl` seconds or can be removed from `ldap.cache_dir`.
|
||||
|
||||
### Monitor not creating tickets
|
||||
- Verify `config.json → ticket_api.api_key` is set and valid
|
||||
- Check `journalctl -u gandalf-monitor` for `Ticket creation failed` lines
|
||||
- Confirm the Tinker Tickets API is reachable from LXC 157
|
||||
|
||||
### Link Debug shows no data / "Loading…" forever
|
||||
### WAN / Fiber panel missing or showing "unavailable"
|
||||
- The panel stays hidden until `config.json → modem.url` is set and the monitor has completed a cycle
|
||||
- Test from the monitor host: `curl -s -o /dev/null -w '%{http_code}\n' http://192.168.1.254/cgi-bin/fiberstat.ha` should print `200`
|
||||
- `modem_data_invalid` means the gateway answered but its pages couldn't be parsed. AT&T updates firmware automatically, so compare the page against the parsers in `modem.py` (markup confirmed on BGW320-505 firmware 6.35.8)
|
||||
|
||||
### Device pages show no interface data
|
||||
- Check `gandalf-monitor.service` is running and has completed at least one cycle
|
||||
- Check `journalctl -u gandalf-monitor` for Prometheus or UniFi errors
|
||||
- Verify Prometheus is reachable: `curl http://10.10.10.48:9090/api/v1/query?query=up`
|
||||
|
||||
### Link Debug: SFP DOM panel missing
|
||||
### Device page: SFP / optical panel missing
|
||||
- SFP data requires Pulse worker + SSH access to hosts
|
||||
- Verify `config.json → pulse.*` is configured and the Pulse worker is running
|
||||
- Confirm `sshpass` + SSH access from the Pulse worker to each Proxmox host
|
||||
- Only interfaces with physical SFP modules return DOM data (`ethtool -m`)
|
||||
|
||||
### Inspector: path debug section not appearing
|
||||
- Requires LLDP: run `apt install lldpd && systemctl enable --now lldpd` on each server
|
||||
- The LLDP `system_name` broadcast by `lldpd` must match the hostname in `config.json → hosts[].name`
|
||||
- Override: `echo 'configure system hostname large1' > /etc/lldpd.d/hostname.conf && systemctl restart lldpd`
|
||||
- Allow up to 2 poll cycles (240s) after installing lldpd for LLDP table to populate
|
||||
### Port inspector: path check or Run Diagnostics not appearing
|
||||
- These need the port's neighbor to be a host with link stats. A port showing only a MAC couldn't be matched
|
||||
- Check that the server's node_exporter is scraped and reports `node_network_info` for that NIC
|
||||
- Hosts missing from `config.json` are named by IP, so their ports may not match what you expect
|
||||
|
||||
### Inspector: switch chassis shows as flat list (no layout)
|
||||
- The switch's `model` field from UniFi doesn't match any key in `SWITCH_LAYOUTS` in `inspector.html`
|
||||
- Check the UniFi API: the model appears in the `link_stats` API response under `unifi_switches.<name>.model`
|
||||
- Add the model key to `SWITCH_LAYOUTS` in `inspector.html` with the correct row/SFP layout
|
||||
### Port inspector: front panel shows as a flat list (no layout)
|
||||
- The switch's `model` field from UniFi doesn't match any key in `FACEPLATES` in `faceplates.js`
|
||||
- The model is shown on the device page
|
||||
- Add the model to `FACEPLATES` in `faceplates.js` (see Adding a New Device Faceplate)
|
||||
|
||||
### Baseline re-initializing on every restart
|
||||
- `interface_baseline` is stored in the `monitor_state` DB table; survives restarts
|
||||
@@ -421,18 +518,22 @@ curl http://10.10.10.48:9090/api/v1/query?query=up | jq '.data.result[] | select
|
||||
gandalf/
|
||||
├── app.py # Flask web app (routes, auth, API endpoints)
|
||||
├── monitor.py # Background daemon (Prometheus, UniFi, Pulse, alert logic)
|
||||
├── modem.py # Read-only AT&T gateway status page client and parser
|
||||
├── devices.py # Device inventory for search and device pages
|
||||
├── db.py # Database operations (MariaDB via pymysql, thread-local conn reuse)
|
||||
├── schema.sql # Database schema (network_events, suppression_rules, monitor_state)
|
||||
├── config.json # Runtime configuration (not committed with secrets)
|
||||
├── requirements.txt # Python dependencies
|
||||
├── static/
|
||||
│ ├── style.css # Terminal aesthetic CSS (CRT scanlines, green-on-black)
|
||||
│ └── app.js # Dashboard JS (auto-refresh, host grid, events, suppress modal)
|
||||
│ ├── app.js # Dashboard JS (auto-refresh, events, suppress modal, search, modem panel)
|
||||
│ ├── device.js # Device page rendering
|
||||
│ └── port-inspector.js # Switch front panel, port panel, path check, diagnostics
|
||||
└── templates/
|
||||
├── base.html # Shared layout (header, nav, footer)
|
||||
├── index.html # Dashboard page
|
||||
├── links.html # Link Debug page (server NICs + UniFi switch ports)
|
||||
├── inspector.html # Visual switch inspector + LLDP path debug
|
||||
├── device.html # Per-device page
|
||||
├── _modem_panel.html # WAN / Fiber panel, shared by the dashboard and modem page
|
||||
└── suppressions.html # Suppression management page
|
||||
```
|
||||
|
||||
@@ -447,25 +548,32 @@ gandalf/
|
||||
4. Restart monitor: `systemctl restart gandalf-monitor`
|
||||
5. For SFP DOM / ethtool: ensure the host is SSH-accessible from the Pulse worker
|
||||
|
||||
### Adding a New Switch Layout (Inspector)
|
||||
### Adding a New Device Faceplate
|
||||
|
||||
Find the UniFi model code for the switch (it appears in the `/api/links` JSON response
|
||||
under `unifi_switches.<switch_name>.model`), then add to `SWITCH_LAYOUTS` in
|
||||
`templates/inspector.html`:
|
||||
Find the UniFi model code on the device page, then add an entry to `FACEPLATES` in `static/faceplates.js`.
|
||||
Trace coordinates from a front-on image of the device, using the image's pixels as the `viewBox`:
|
||||
|
||||
```javascript
|
||||
'MYNEWMODEL': {
|
||||
rows: [[1,2,3,4,5,6,7,8], [9,10,11,12,13,14,15,16]], // port_idx by row
|
||||
sfp_section: [17, 18], // separate SFP cage ports (rendered below rows)
|
||||
sfp_ports: [], // port_idx values that are SFP-type within rows
|
||||
width: 1100, height: 110, frameClass: 'fp-scroll', scrollX: 500,
|
||||
label: 'My New Switch',
|
||||
legend: [['off', 'no link'], ['amber', '10/100M'], ['green', '1G']],
|
||||
roles: { 1: 'RJ45' },
|
||||
ports: rj45Pairs([520, 557, 594], { top: 38, bottom: 69, topLabel: 15.5, bottomLabel: 98 }),
|
||||
decor() { return fpVents([[90, 500]], 3) + fpQuadScreen(15, 23, 60); },
|
||||
},
|
||||
```
|
||||
|
||||
Take LED colors from the model's quick start guide. See the comment at the top of the file for every option.
|
||||
|
||||
### Database Schema Notes
|
||||
|
||||
- `network_events`: one row per active event; `resolved_at` is set when recovered
|
||||
- `suppression_rules`: `active=FALSE` when removed; `expires_at` checked at query time
|
||||
- `monitor_state`: key/value store; `interface_baseline` and `link_stats` are JSON blobs
|
||||
- `monitor_state`: key/value store; `interface_baseline`, `link_stats`, and `modem_stats` are JSON blobs
|
||||
- `monitor_state` also holds `wan_history` (WAN outages, modem restarts) and `unifi_log_cursor` (how far the UniFi log has been read)
|
||||
- Database sessions run in UTC (`db.py`), whatever the server's time zone
|
||||
- `modem_samples`: optical readings per poll, kept 90 days; created automatically at monitor startup
|
||||
|
||||
### Security Notes
|
||||
|
||||
@@ -501,11 +609,16 @@ under `unifi_switches.<switch_name>.model`), then add to `SWITCH_LAYOUTS` in
|
||||
|---|---|---|
|
||||
| `lint.yml` (python-lint) | flake8 on all `.py` files | Every push and PR |
|
||||
| `lint.yml` (js-lint) | ESLint on `static/` | Every push and PR |
|
||||
| `test.yml` | pytest — 33 tests for `diagnose.py` static methods | Every push and PR |
|
||||
| `test.yml` | pytest — `diagnose.py`, `modem.py`, and `monitor.py` alert logic | Every push and PR |
|
||||
| `security.yml` | bandit `-ll` (medium+ severity) | Every push, PR, and weekly Monday 6am |
|
||||
| `deploy` job in `lint.yml` | Calls the `gandalf-deploy` webhook on CT157 (10.10.10.61) | Push to `main` only, after both lint jobs pass |
|
||||
|
||||
Branch protection is enabled on `main` — both lint jobs must pass before any PR can merge.
|
||||
|
||||
Tests live in `tests/test_diagnose.py` and cover `DiagnosticsRunner` static methods:
|
||||
`build_ssh_command`, `parse_output`, `parse_sysfs_stats`, `parse_ethtool`, and variants.
|
||||
Tests live in `tests/`:
|
||||
- `test_diagnose.py`: `DiagnosticsRunner` static methods (`build_ssh_command`, `parse_output`,
|
||||
`parse_sysfs_stats`, `parse_ethtool`, and variants)
|
||||
- `test_modem.py`: gateway page parsing, optical status, and WAN state
|
||||
- `test_monitor.py`: alert logic for dead hosts, Prometheus and Pulse outages, and modem and WAN log events
|
||||
- `test_devices.py`: device inventory behind search and device pages
|
||||
- `test_app.py`: page and API routes
|
||||
@@ -18,9 +18,10 @@ import uuid
|
||||
from datetime import datetime, timezone
|
||||
from functools import wraps
|
||||
|
||||
from flask import Flask, jsonify, make_response, render_template, request, send_file
|
||||
from flask import Flask, jsonify, make_response, redirect, render_template, request, send_file, url_for
|
||||
|
||||
import db
|
||||
import devices
|
||||
import diagnose
|
||||
from monitor import PulseClient
|
||||
|
||||
@@ -196,6 +197,18 @@ def _annotate_suppressions(events: list, suppressions: list) -> None:
|
||||
ev['is_suppressed'] = db.check_suppressed(suppressions, 'host', name, detail)
|
||||
|
||||
|
||||
def _state_json(key: str) -> dict:
|
||||
"""Return a monitor_state JSON blob as a dict, or {} if missing or unreadable."""
|
||||
raw = db.get_state(key)
|
||||
if not raw:
|
||||
return {}
|
||||
try:
|
||||
return json.loads(raw)
|
||||
except Exception as e:
|
||||
logger.error(f'Failed to parse {key} JSON: {e}')
|
||||
return {}
|
||||
|
||||
|
||||
# ---------------------------------------------------------------------------
|
||||
# Page routes
|
||||
# ---------------------------------------------------------------------------
|
||||
@@ -235,15 +248,21 @@ def index():
|
||||
@app.route('/links')
|
||||
@require_auth
|
||||
def links_page():
|
||||
user = _get_user()
|
||||
return render_template('links.html', user=user)
|
||||
"""Link Debug moved to the per-device pages; keep old bookmarks working."""
|
||||
return redirect(url_for('index'))
|
||||
|
||||
|
||||
@app.route('/device/<path:name>')
|
||||
@require_auth
|
||||
def device_page(name: str):
|
||||
return render_template('device.html', user=_get_user(), device_name=name)
|
||||
|
||||
|
||||
@app.route('/inspector')
|
||||
@require_auth
|
||||
def inspector():
|
||||
user = _get_user()
|
||||
return render_template('inspector.html', user=user)
|
||||
"""The port inspector moved to each switch's device page; keep old bookmarks working."""
|
||||
return redirect(url_for('index'))
|
||||
|
||||
|
||||
@app.route('/suppressions')
|
||||
@@ -315,6 +334,60 @@ def api_links():
|
||||
return jsonify({'hosts': {}, 'unifi_switches': {}, 'updated': None})
|
||||
|
||||
|
||||
@app.route('/api/modem')
|
||||
@require_auth
|
||||
def api_modem():
|
||||
"""Latest WAN modem status plus optical history for the trend chart."""
|
||||
try:
|
||||
hours = max(1, min(int(request.args.get('hours', 168)), 2160))
|
||||
except ValueError:
|
||||
return jsonify({'error': 'hours must be an integer'}), 400
|
||||
|
||||
raw = db.get_state('modem_stats')
|
||||
if not raw:
|
||||
return jsonify({'configured': False})
|
||||
try:
|
||||
data = json.loads(raw)
|
||||
except Exception as e:
|
||||
logger.error(f'Failed to parse modem_stats JSON: {e}')
|
||||
return jsonify({'configured': False})
|
||||
|
||||
# A history failure shouldn't take the current readings down with it.
|
||||
try:
|
||||
# Keep roughly 200 points regardless of range; never finer than the 5 min poll.
|
||||
data['history'] = db.get_modem_history(hours, max(300, hours * 3600 // 200))
|
||||
except Exception as e:
|
||||
logger.error(f'Failed to load modem history: {e}')
|
||||
data['history'] = []
|
||||
data['wan_history'] = _state_json('wan_history')
|
||||
data['configured'] = True
|
||||
return jsonify(data)
|
||||
|
||||
|
||||
@app.route('/api/devices')
|
||||
@require_auth
|
||||
def api_devices():
|
||||
"""Device list for the home page search."""
|
||||
return jsonify({'devices': devices.build_index(
|
||||
_state_json('network_snapshot'), _state_json('link_stats'), _state_json('modem_stats'),
|
||||
)})
|
||||
|
||||
|
||||
@app.route('/api/device/<path:name>')
|
||||
@require_auth
|
||||
def api_device(name: str):
|
||||
"""Everything known about one device, for its detail page."""
|
||||
detail = devices.device_detail(
|
||||
name, _state_json('network_snapshot'), _state_json('link_stats'), _state_json('modem_stats'),
|
||||
)
|
||||
if detail is None:
|
||||
return jsonify({'error': f'No device named "{name}"'}), 404
|
||||
events = db.get_events_for_target(name)
|
||||
_annotate_suppressions(events, db.get_active_suppressions())
|
||||
detail['events'] = events
|
||||
return jsonify(detail)
|
||||
|
||||
|
||||
@app.route('/api/events')
|
||||
@require_auth
|
||||
def api_events():
|
||||
@@ -436,6 +509,7 @@ def api_diagnose_start():
|
||||
if pd.get('port_idx') == port_idx:
|
||||
port_data = dict(pd)
|
||||
port_data['name'] = pname
|
||||
port_data['switch_name'] = switch_name
|
||||
break
|
||||
if not port_data:
|
||||
return jsonify({'error': f'Port {port_idx} not found on switch "{switch_name}"'}), 404
|
||||
@@ -558,6 +632,7 @@ def api_avatar():
|
||||
|
||||
ldap_cfg = _config().get('ldap', {})
|
||||
if not ldap_cfg.get('host') or not ldap_cfg.get('bind_dn'):
|
||||
logger.warning('Avatar unavailable: config.json has no ldap.host / ldap.bind_dn')
|
||||
return '', 404
|
||||
|
||||
# Build a safe cache filename from the username (alphanumeric + - _ .)
|
||||
@@ -588,6 +663,7 @@ def api_avatar():
|
||||
# Skip LDAP if we already know this user has no avatar
|
||||
try:
|
||||
if os.path.exists(sentinel) and now - os.path.getmtime(sentinel) < cache_ttl:
|
||||
logger.info(f'Avatar for {username!r}: cached "no photo" marker is still valid')
|
||||
return '', 404
|
||||
except OSError:
|
||||
pass
|
||||
@@ -626,6 +702,7 @@ def api_avatar():
|
||||
pass
|
||||
|
||||
if not avatar_data or len(avatar_data) < 100:
|
||||
logger.warning(f'Avatar for {username!r}: LDAP has no photo (or no user with that uid)')
|
||||
with open(sentinel, 'w'):
|
||||
pass
|
||||
return '', 404
|
||||
|
||||
@@ -34,6 +34,9 @@ def _new_conn(cfg: dict):
|
||||
cursorclass=pymysql.cursors.DictCursor,
|
||||
connect_timeout=10,
|
||||
charset='utf8mb4',
|
||||
# All app code treats database times as UTC. Without this, a server in another
|
||||
# time zone shifts displayed ages and timed suppression expiries by its offset.
|
||||
init_command="SET time_zone='+00:00'",
|
||||
)
|
||||
|
||||
|
||||
@@ -145,6 +148,24 @@ def upsert_event(
|
||||
return cur.lastrowid, True, 1, None
|
||||
|
||||
|
||||
def get_events_for_target(target_name: str, limit: int = 25) -> list:
|
||||
"""Return a device's events, unresolved first, then most recent."""
|
||||
with get_conn() as conn:
|
||||
with conn.cursor() as cur:
|
||||
cur.execute(
|
||||
"""SELECT * FROM network_events WHERE target_name=%s
|
||||
ORDER BY resolved_at IS NOT NULL, COALESCE(resolved_at, last_seen) DESC
|
||||
LIMIT %s""",
|
||||
(target_name, limit),
|
||||
)
|
||||
rows = cur.fetchall()
|
||||
for r in rows:
|
||||
for k in ('first_seen', 'last_seen', 'resolved_at'):
|
||||
if r.get(k) and hasattr(r[k], 'isoformat'):
|
||||
r[k] = r[k].isoformat() + 'Z'
|
||||
return rows
|
||||
|
||||
|
||||
def resolve_event(event_type: str, target_name: str, target_detail: str = '') -> None:
|
||||
detail = target_detail or ''
|
||||
with get_conn() as conn:
|
||||
@@ -332,6 +353,80 @@ def purge_old_resolved_events(days: int = 90) -> int:
|
||||
return n
|
||||
|
||||
|
||||
# ---------------------------------------------------------------------------
|
||||
# WAN modem optical history
|
||||
# ---------------------------------------------------------------------------
|
||||
|
||||
def ensure_modem_schema() -> None:
|
||||
"""Create the modem history table so deploys need no manual migration."""
|
||||
with get_conn() as conn:
|
||||
with conn.cursor() as cur:
|
||||
cur.execute(
|
||||
"""CREATE TABLE IF NOT EXISTS modem_samples (
|
||||
sampled_at TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP PRIMARY KEY,
|
||||
rx_power_dbm DECIMAL(5,1) NULL,
|
||||
tx_power_dbm DECIMAL(5,1) NULL,
|
||||
temp_c DECIMAL(5,1) NULL
|
||||
) ENGINE=InnoDB"""
|
||||
)
|
||||
|
||||
|
||||
def record_modem_sample(rx_power_dbm, tx_power_dbm, temp_c) -> None:
|
||||
with get_conn() as conn:
|
||||
with conn.cursor() as cur:
|
||||
cur.execute(
|
||||
"""INSERT INTO modem_samples (sampled_at, rx_power_dbm, tx_power_dbm, temp_c)
|
||||
VALUES (NOW(), %s, %s, %s)
|
||||
ON DUPLICATE KEY UPDATE rx_power_dbm=VALUES(rx_power_dbm),
|
||||
tx_power_dbm=VALUES(tx_power_dbm), temp_c=VALUES(temp_c)""",
|
||||
(rx_power_dbm, tx_power_dbm, temp_c),
|
||||
)
|
||||
|
||||
|
||||
def get_modem_rx_values(days: int = 7) -> list:
|
||||
"""Return recent Rx power readings (dBm) for computing a drift baseline."""
|
||||
with get_conn() as conn:
|
||||
with conn.cursor() as cur:
|
||||
cur.execute(
|
||||
"""SELECT rx_power_dbm FROM modem_samples
|
||||
WHERE rx_power_dbm IS NOT NULL
|
||||
AND sampled_at > DATE_SUB(NOW(), INTERVAL %s DAY)""",
|
||||
(days,),
|
||||
)
|
||||
return [float(r['rx_power_dbm']) for r in cur.fetchall()]
|
||||
|
||||
|
||||
def get_modem_history(hours: int = 168, bucket_seconds: int = 3600) -> list:
|
||||
"""Return optical history averaged into time buckets, oldest first."""
|
||||
with get_conn() as conn:
|
||||
with conn.cursor() as cur:
|
||||
cur.execute(
|
||||
"""SELECT FLOOR(UNIX_TIMESTAMP(sampled_at) / %s) * %s AS ts,
|
||||
ROUND(AVG(rx_power_dbm), 1) AS rx_avg,
|
||||
MIN(rx_power_dbm) AS rx_min,
|
||||
ROUND(AVG(tx_power_dbm), 1) AS tx_avg,
|
||||
ROUND(AVG(temp_c), 1) AS temp_avg
|
||||
FROM modem_samples
|
||||
WHERE sampled_at > DATE_SUB(NOW(), INTERVAL %s HOUR)
|
||||
GROUP BY ts ORDER BY ts""",
|
||||
(bucket_seconds, bucket_seconds, hours),
|
||||
)
|
||||
return [
|
||||
{k: (float(v) if v is not None else None) for k, v in row.items()}
|
||||
for row in cur.fetchall()
|
||||
]
|
||||
|
||||
|
||||
def purge_old_modem_samples(days: int = 90) -> int:
|
||||
with get_conn() as conn:
|
||||
with conn.cursor() as cur:
|
||||
cur.execute(
|
||||
'DELETE FROM modem_samples WHERE sampled_at < DATE_SUB(NOW(), INTERVAL %s DAY)',
|
||||
(days,),
|
||||
)
|
||||
return cur.rowcount
|
||||
|
||||
|
||||
def check_suppressed(suppressions: list, target_type: str, target_name: str, target_detail: str = '') -> bool:
|
||||
"""Check suppression against a pre-loaded list (avoids per-call DB queries)."""
|
||||
for s in suppressions:
|
||||
|
||||
@@ -0,0 +1,228 @@
|
||||
"""Device inventory built from the monitor's cached state.
|
||||
|
||||
Pure functions with no I/O: app.py passes in the JSON blobs the monitor stored,
|
||||
so search and the per-device pages always agree about what a device is.
|
||||
"""
|
||||
import re
|
||||
from typing import Dict, List, Optional
|
||||
|
||||
# UniFi reports PDUs as switches or APs, so model codes take priority over type.
|
||||
_PDU_MODELS = {'USPPDUP', 'UP6', 'USPDA2B'}
|
||||
_KIND_BY_TYPE = {
|
||||
'usw': 'switch', 'udm': 'router', 'ugw': 'router', 'uxg': 'router',
|
||||
'uap': 'ap', 'usp': 'pdu',
|
||||
}
|
||||
|
||||
|
||||
def unifi_kind(unifi_type: str, model: str) -> str:
|
||||
if model in _PDU_MODELS:
|
||||
return 'pdu'
|
||||
return _KIND_BY_TYPE.get((unifi_type or '').lower(), 'device')
|
||||
|
||||
|
||||
def _mac_forms(mac: str) -> List[str]:
|
||||
"""Return a MAC with and without separators, so either spelling is searchable."""
|
||||
return [mac, re.sub(r'[^0-9a-fA-F]', '', mac)] if mac else []
|
||||
|
||||
|
||||
def _search_text(*parts) -> str:
|
||||
flat = []
|
||||
for p in parts:
|
||||
if isinstance(p, (list, tuple, set)):
|
||||
flat.extend(str(x) for x in p if x)
|
||||
elif p:
|
||||
flat.append(str(p))
|
||||
return ' '.join(flat).lower()
|
||||
|
||||
|
||||
def _port_neighbors(ports: dict) -> List[str]:
|
||||
return [p['lldp']['system_name'] for p in ports.values()
|
||||
if (p.get('lldp') or {}).get('system_name')]
|
||||
|
||||
|
||||
def build_index(snapshot: dict, link_stats: dict, modem: Optional[dict]) -> List[dict]:
|
||||
"""Return every known device as {name, kind, status, ip, model, ..., search}."""
|
||||
snapshot = snapshot or {}
|
||||
link_stats = link_stats or {}
|
||||
devices: Dict[str, dict] = {}
|
||||
|
||||
for name, host in (snapshot.get('hosts') or {}).items():
|
||||
link_ifaces = (link_stats.get('hosts') or {}).get(name) or {}
|
||||
ifaces = sorted(set(host.get('interfaces') or {}) | set(link_ifaces))
|
||||
devices[name] = {
|
||||
'name': name, 'kind': 'host', 'status': host.get('status', 'unknown'),
|
||||
'ip': host.get('ip', ''), 'mac': '', 'model': '', 'source': host.get('source', ''),
|
||||
'interface_count': len(ifaces),
|
||||
'search': _search_text(name, host.get('ip'), 'host server', ifaces),
|
||||
}
|
||||
|
||||
# Prometheus also sees hosts that aren't in config.json, e.g. LXC app servers.
|
||||
# They have link stats but no alerting, so their state is reported as unknown.
|
||||
for name, ifaces in (link_stats.get('hosts') or {}).items():
|
||||
if name not in devices:
|
||||
ip = next((i.get('host_ip') for i in ifaces.values() if i.get('host_ip')), '')
|
||||
devices[name] = {
|
||||
'name': name, 'kind': 'host', 'status': 'unknown', 'ip': ip, 'mac': '', 'model': '',
|
||||
'source': 'prometheus', 'interface_count': len(ifaces),
|
||||
'search': _search_text(name, ip, 'host server', list(ifaces)),
|
||||
}
|
||||
|
||||
switches = link_stats.get('unifi_switches') or {}
|
||||
for d in snapshot.get('unifi') or []:
|
||||
name = d.get('name', '')
|
||||
ports = (switches.get(name) or {}).get('ports') or {}
|
||||
kind = unifi_kind(d.get('type', ''), d.get('model', ''))
|
||||
devices[name] = {
|
||||
'name': name, 'kind': kind, 'status': 'up' if d.get('connected') else 'down',
|
||||
'ip': d.get('ip', ''), 'mac': d.get('mac', ''), 'model': d.get('model', ''),
|
||||
'source': 'unifi', 'interface_count': len(ports),
|
||||
'search': _search_text(
|
||||
name, d.get('ip'), _mac_forms(d.get('mac', '')), d.get('model'),
|
||||
d.get('type'), kind, list(ports), _port_neighbors(ports),
|
||||
),
|
||||
}
|
||||
|
||||
# A switch can have link stats while the device list is unavailable this cycle.
|
||||
for name, sw in switches.items():
|
||||
if name not in devices:
|
||||
ports = sw.get('ports') or {}
|
||||
devices[name] = {
|
||||
'name': name, 'kind': unifi_kind('usw', sw.get('model', '')), 'status': 'unknown',
|
||||
'ip': sw.get('ip', ''), 'mac': '', 'model': sw.get('model', ''),
|
||||
'source': 'unifi', 'interface_count': len(ports),
|
||||
'search': _search_text(name, sw.get('ip'), sw.get('model'), list(ports), _port_neighbors(ports)),
|
||||
}
|
||||
|
||||
if modem and modem.get('name'):
|
||||
name = modem['name']
|
||||
if not modem.get('reachable'):
|
||||
status = 'unknown'
|
||||
else:
|
||||
status = 'down' if modem.get('wan_problems') else 'up'
|
||||
devices[name] = {
|
||||
'name': name, 'kind': 'modem', 'status': status,
|
||||
'ip': modem.get('lan_ip', ''), 'mac': '', 'model': modem.get('model', ''),
|
||||
'source': 'modem', 'interface_count': 0,
|
||||
'search': _search_text(
|
||||
name, modem.get('lan_ip'), modem.get('wan_ip'), modem.get('model'),
|
||||
'modem gateway fiber wan at&t att',
|
||||
),
|
||||
}
|
||||
|
||||
return sorted(devices.values(), key=lambda d: d['name'].lower())
|
||||
|
||||
|
||||
_MAC_RE = re.compile(r'^[0-9a-f]{2}(:[0-9a-f]{2}){5}$')
|
||||
|
||||
|
||||
def _norm_mac(value: Optional[str]) -> str:
|
||||
mac = (value or '').strip().lower().replace('-', ':')
|
||||
return mac if _MAC_RE.match(mac) else ''
|
||||
|
||||
|
||||
def resolve_lldp_neighbors(
|
||||
switches: dict,
|
||||
host_macs: Dict[str, tuple],
|
||||
device_macs: Dict[str, str],
|
||||
host_ips: Dict[str, str],
|
||||
) -> None:
|
||||
"""Fill in LLDP neighbor names in place.
|
||||
|
||||
UniFi's API reports a neighbor's MAC, port ID, and sometimes management IPs, but no
|
||||
system name. Names come from what Gandalf already knows:
|
||||
|
||||
host_macs: {mac: (host, interface)} from node_network_info
|
||||
device_macs: {mac: device name} from UniFi
|
||||
host_ips: {ip: host}
|
||||
"""
|
||||
for sw in (switches or {}).values():
|
||||
for port in (sw.get('ports') or {}).values():
|
||||
lldp = port.get('lldp')
|
||||
if not lldp or lldp.get('system_name'):
|
||||
continue
|
||||
port_mac = _norm_mac(lldp.get('port_id'))
|
||||
chassis_mac = _norm_mac(lldp.get('chassis_id'))
|
||||
if port_mac in host_macs:
|
||||
# The port ID names the exact NIC, so it also gives the interface.
|
||||
lldp['system_name'], lldp['port_id'] = host_macs[port_mac]
|
||||
elif chassis_mac in host_macs:
|
||||
lldp['system_name'] = host_macs[chassis_mac][0]
|
||||
elif chassis_mac in device_macs or port_mac in device_macs:
|
||||
lldp['system_name'] = device_macs.get(chassis_mac) or device_macs[port_mac]
|
||||
else:
|
||||
lldp['system_name'] = next(
|
||||
(host_ips[ip] for ip in lldp.get('mgmt_ips') or [] if ip in host_ips), '',
|
||||
)
|
||||
|
||||
|
||||
def apply_client_locations(
|
||||
switches: dict,
|
||||
clients: List[dict],
|
||||
host_macs: Dict[str, tuple],
|
||||
device_macs: Dict[str, str],
|
||||
) -> None:
|
||||
"""Name server neighbors from UniFi's wired client table, where LLDP gave no name.
|
||||
|
||||
This finds servers that don't run lldpd. Uplink ports are skipped because they
|
||||
carry traffic from devices further downstream.
|
||||
"""
|
||||
for client in clients or []:
|
||||
mac = _norm_mac(client.get('mac'))
|
||||
switch = device_macs.get(_norm_mac(client.get('sw_mac')))
|
||||
if mac not in host_macs or switch not in (switches or {}):
|
||||
continue
|
||||
for port in (switches[switch].get('ports') or {}).values():
|
||||
if port.get('port_idx') != client.get('sw_port') or port.get('is_uplink'):
|
||||
continue
|
||||
if (port.get('lldp') or {}).get('system_name'):
|
||||
continue
|
||||
host, iface = host_macs[mac]
|
||||
port['lldp'] = {
|
||||
'system_name': host, 'port_id': iface, 'chassis_id': mac,
|
||||
'port_desc': '', 'mgmt_ips': [], 'source': 'unifi-clients',
|
||||
}
|
||||
|
||||
|
||||
def uplinks_for_host(name: str, switches: dict) -> List[dict]:
|
||||
"""Find the switch ports whose LLDP neighbor is this host."""
|
||||
found = []
|
||||
for sw_name, sw in (switches or {}).items():
|
||||
for port_name, port in (sw.get('ports') or {}).items():
|
||||
lldp = port.get('lldp') or {}
|
||||
if lldp.get('system_name') == name:
|
||||
found.append({
|
||||
'switch': sw_name, 'port': port_name, 'port_idx': port.get('port_idx'),
|
||||
'host_interface': lldp.get('port_id', ''), 'up': port.get('up', False),
|
||||
'speed_mbps': port.get('speed_mbps', 0),
|
||||
})
|
||||
return found
|
||||
|
||||
|
||||
def device_detail(name: str, snapshot: dict, link_stats: dict, modem: Optional[dict]) -> Optional[dict]:
|
||||
"""Return everything known about one device, or None if it doesn't exist."""
|
||||
match = next((d for d in build_index(snapshot, link_stats, modem) if d['name'] == name), None)
|
||||
if match is None:
|
||||
return None
|
||||
link_stats = link_stats or {}
|
||||
detail = {k: v for k, v in match.items() if k != 'search'}
|
||||
switches = link_stats.get('unifi_switches') or {}
|
||||
|
||||
if match['kind'] == 'host':
|
||||
states = ((snapshot or {}).get('hosts') or {}).get(name, {}).get('interfaces') or {}
|
||||
link_ifaces = (link_stats.get('hosts') or {}).get(name) or {}
|
||||
interfaces = {i: {'state': s} for i, s in states.items()}
|
||||
for iface, stats in link_ifaces.items():
|
||||
interfaces.setdefault(iface, {}).update(stats)
|
||||
detail['interfaces'] = interfaces
|
||||
detail['uplinks'] = uplinks_for_host(name, switches)
|
||||
elif match['kind'] == 'modem':
|
||||
pass # the page renders the shared WAN / Fiber panel from /api/modem
|
||||
else:
|
||||
detail['ports'] = (switches.get(name) or {}).get('ports') or {}
|
||||
# The port panel compares each port with the server on the other end
|
||||
hosts = link_stats.get('hosts') or {}
|
||||
neighbors = set(_port_neighbors(detail['ports']))
|
||||
detail['neighbor_hosts'] = {h: ifaces for h, ifaces in hosts.items() if h in neighbors}
|
||||
detail['info'] = (link_stats.get('unifi_devices') or {}).get(name) or {}
|
||||
detail['updated'] = link_stats.get('updated')
|
||||
return detail
|
||||
@@ -530,15 +530,17 @@ class DiagnosticsRunner:
|
||||
add(warnings, 'KERNEL_EVENTS',
|
||||
f'{len(err_events)} recent kernel error event(s) for this interface in dmesg')
|
||||
|
||||
# LLDP validation
|
||||
# LLDP validation: the neighbour the *server's* lldpd sees should be the switch
|
||||
# that this port belongs to. (The switch port's own LLDP entry describes the server,
|
||||
# so it must not be compared with the server's view of the switch.)
|
||||
if lldp.get('available'):
|
||||
sw_lldp = switch_port_data.get('lldp') or {}
|
||||
sw_system = (sw_lldp.get('system_name') or '').lower()
|
||||
expected_switch = (switch_port_data.get('switch_name') or '').lower()
|
||||
srv_neighbor = (lldp.get('neighbor_system') or '').lower()
|
||||
if sw_system and srv_neighbor and sw_system not in srv_neighbor and srv_neighbor not in sw_system:
|
||||
names_differ = expected_switch not in srv_neighbor and srv_neighbor not in expected_switch
|
||||
if expected_switch and srv_neighbor and names_differ:
|
||||
add(warnings, 'LLDP_MISMATCH',
|
||||
f'LLDP mismatch: switch sees "{sw_lldp.get("system_name")}" but '
|
||||
f'server lldpctl sees "{lldp.get("neighbor_system")}" — cross-cabled port?')
|
||||
f'LLDP mismatch: this port is on "{switch_port_data.get("switch_name")}" but the server\'s '
|
||||
f'lldpctl sees "{lldp.get("neighbor_system")}" — cross-cabled port?')
|
||||
else:
|
||||
add(info, 'LLDP_MISSING',
|
||||
'lldpd not running on server — install lldpd for full path validation')
|
||||
|
||||
|
After Width: | Height: | Size: 88 KiB |
|
After Width: | Height: | Size: 164 KiB |
|
After Width: | Height: | Size: 674 KiB |
|
After Width: | Height: | Size: 67 KiB |
|
After Width: | Height: | Size: 145 KiB |
|
After Width: | Height: | Size: 162 KiB |
|
After Width: | Height: | Size: 108 KiB |
|
After Width: | Height: | Size: 214 KiB |
|
After Width: | Height: | Size: 90 KiB |
@@ -0,0 +1,287 @@
|
||||
"""Read-only client for AT&T BGW-series fiber gateways (tested on BGW320-505).
|
||||
|
||||
The gateway has no API, but its status pages are served without a login, so
|
||||
this scrapes them over HTTP. Only GET requests to the fixed status pages below
|
||||
are ever made: nothing here can change gateway settings.
|
||||
|
||||
Units come from the gateway's own help text, checked against live readings:
|
||||
Rx/Tx power tenths of a dBm (-169 -> -16.9 dBm)
|
||||
Temperature degrees C
|
||||
Uptime seconds (despite the help text claiming D:H:M:S)
|
||||
|
||||
Deliberately not used, because the page disagrees with itself:
|
||||
Vcc / Tx Bias readings values do not match the documented scales, so only
|
||||
their alarm/warning flags are kept
|
||||
Rx LOS State reads 1 on a healthy link; "Optical WAN Operational
|
||||
Status" is the reliable signal
|
||||
Last Change does not count up, despite the help text
|
||||
"""
|
||||
import html
|
||||
import logging
|
||||
import re
|
||||
from datetime import datetime, timezone
|
||||
from typing import Dict, List, Optional
|
||||
|
||||
import requests
|
||||
|
||||
logger = logging.getLogger('gandalf.modem')
|
||||
|
||||
_FIBER_PAGE = '/cgi-bin/fiberstat.ha'
|
||||
_BROADBAND_PAGE = '/cgi-bin/broadbandstatistics.ha'
|
||||
_SYSINFO_PAGE = '/cgi-bin/sysinfo.ha'
|
||||
|
||||
_ROW_RE = re.compile(r'<th\b[^>]*>(.*?)</th>\s*<td\b[^>]*>(.*?)</td>', re.I | re.S)
|
||||
_TAG_RE = re.compile(r'<[^>]+>')
|
||||
# e.g. "0 (Threshold -292)": alarm flag, then the limit
|
||||
_DOM_CELL_RE = re.compile(r'<td\b[^>]*>\s*(\d+)\s*\(Threshold\s+(-?\d+)\)\s*</td>', re.I)
|
||||
|
||||
# Page heading -> (result key, scale to real units; None = reading is unusable)
|
||||
_DOM_METRICS = {
|
||||
'Temperature': ('temperature', 1.0),
|
||||
'Vcc': ('vcc', None),
|
||||
'Tx Bias': ('tx_bias', None),
|
||||
'Tx Power': ('tx_power', 0.1),
|
||||
'Rx Power': ('rx_power', 0.1),
|
||||
}
|
||||
|
||||
_COUNTERS = {
|
||||
'rx_bytes': 'Receive Bytes',
|
||||
'tx_bytes': 'Transmit Bytes',
|
||||
'rx_errors': 'Receive Errors',
|
||||
'tx_errors': 'Transmit Errors',
|
||||
'rx_drops': 'Receive Drops',
|
||||
'tx_drops': 'Transmit Drops',
|
||||
}
|
||||
|
||||
|
||||
class ModemUnreachable(Exception):
|
||||
"""The gateway did not answer (power, cabling, or routing problem)."""
|
||||
|
||||
|
||||
class ModemDataInvalid(Exception):
|
||||
"""The gateway answered but the page was not what we can parse.
|
||||
|
||||
AT&T pushes firmware automatically, so this is how a layout change or a
|
||||
newly login-protected page shows up.
|
||||
"""
|
||||
|
||||
|
||||
def parse_rows(page: str) -> Dict[str, str]:
|
||||
"""Return {label: value} for the page's <th>/<td> rows; the first label wins.
|
||||
|
||||
First wins because labels repeat: "Transmit Packets" appears under both
|
||||
IPv4 and IPv6, and the IPv4 block comes first.
|
||||
"""
|
||||
rows: Dict[str, str] = {}
|
||||
for label, value in _ROW_RE.findall(page):
|
||||
key = html.unescape(_TAG_RE.sub('', label)).strip()
|
||||
if key:
|
||||
rows.setdefault(key, ' '.join(html.unescape(_TAG_RE.sub('', value)).split()))
|
||||
return rows
|
||||
|
||||
|
||||
def parse_dom_metrics(page: str) -> Dict[str, dict]:
|
||||
"""Parse the fiber page's Temperature / Vcc / Tx Bias / Tx Power / Rx Power tables."""
|
||||
metrics: Dict[str, dict] = {}
|
||||
for heading, (key, scale) in _DOM_METRICS.items():
|
||||
m = re.search(
|
||||
rf'<h1>\s*{re.escape(heading)}(?: |\s)+Currently\s+(-?\d+)\s*</h1>(.*?)</table>',
|
||||
page, re.I | re.S,
|
||||
)
|
||||
if not m:
|
||||
continue
|
||||
cells = _DOM_CELL_RE.findall(m.group(2))
|
||||
if len(cells) != 4: # alarm low, alarm high, warning low, warning high
|
||||
continue
|
||||
|
||||
def limit(raw: str, scale: Optional[float] = scale) -> Optional[float]:
|
||||
return round(int(raw) * scale, 1) if scale is not None else None
|
||||
|
||||
metrics[key] = {
|
||||
'value': limit(m.group(1)),
|
||||
'alarm_low': limit(cells[0][1]),
|
||||
'alarm_high': limit(cells[1][1]),
|
||||
'warn_low': limit(cells[2][1]),
|
||||
'warn_high': limit(cells[3][1]),
|
||||
'alarm_flag': cells[0][0] != '0' or cells[1][0] != '0',
|
||||
'warn_flag': cells[2][0] != '0' or cells[3][0] != '0',
|
||||
}
|
||||
return metrics
|
||||
|
||||
|
||||
def metric_status(metric: dict) -> str:
|
||||
"""Classify a DOM metric as 'alarm', 'warning', or 'ok'.
|
||||
|
||||
Trusts the module's own flags, and also compares the reading to its limits
|
||||
in case the flags are latched off.
|
||||
"""
|
||||
value = metric.get('value')
|
||||
|
||||
def outside(low: Optional[float], high: Optional[float]) -> bool:
|
||||
if value is None:
|
||||
return False
|
||||
return (low is not None and value <= low) or (high is not None and value >= high)
|
||||
|
||||
if metric.get('alarm_flag') or outside(metric.get('alarm_low'), metric.get('alarm_high')):
|
||||
return 'alarm'
|
||||
if metric.get('warn_flag') or outside(metric.get('warn_low'), metric.get('warn_high')):
|
||||
return 'warning'
|
||||
return 'ok'
|
||||
|
||||
|
||||
def _to_int(raw: Optional[str]) -> Optional[int]:
|
||||
try:
|
||||
return int(raw) # type: ignore[arg-type]
|
||||
except (TypeError, ValueError):
|
||||
return None
|
||||
|
||||
|
||||
def wan_problems(data: dict) -> List[str]:
|
||||
"""Return human-readable reasons the WAN is down; empty when it looks healthy."""
|
||||
problems = []
|
||||
if (data.get('broadband_state') or '').lower() != 'up':
|
||||
problems.append(f'broadband connection is {data.get("broadband_state") or "unknown"}')
|
||||
if (data.get('optical_state') or '').lower() != 'up':
|
||||
problems.append(f'optical WAN is {data.get("optical_state") or "unknown"}')
|
||||
pon = data.get('pon_state')
|
||||
if pon and 'O5' not in pon: # O5 is the PON "operation" state; older firmware may omit the field
|
||||
problems.append(f'PON link state is {pon}')
|
||||
return problems
|
||||
|
||||
|
||||
def build_status(fiber_page: str, broadband_page: str, sysinfo_page: str = '') -> dict:
|
||||
"""Combine the status pages into one dict. Raises ModemDataInvalid if unusable."""
|
||||
fiber = parse_rows(fiber_page)
|
||||
broadband = parse_rows(broadband_page)
|
||||
sysinfo = parse_rows(sysinfo_page)
|
||||
|
||||
if 'Optical WAN Operational Status' not in fiber:
|
||||
raise ModemDataInvalid('fiber page is missing "Optical WAN Operational Status"')
|
||||
if 'Broadband Connection' not in broadband:
|
||||
raise ModemDataInvalid('broadband page is missing "Broadband Connection"')
|
||||
|
||||
metrics = parse_dom_metrics(fiber_page)
|
||||
data = {
|
||||
'model': sysinfo.get('Model Number', ''),
|
||||
'firmware': sysinfo.get('Software Version', ''),
|
||||
'uptime_s': _to_int(sysinfo.get('Time Since Last Reboot')),
|
||||
'broadband_state': broadband.get('Broadband Connection', ''),
|
||||
'source': broadband.get('Broadband Connection Source', ''),
|
||||
'wan_ip': broadband.get('Broadband IPv4 Address', ''),
|
||||
'pon_state': broadband.get('PON Link Status', ''),
|
||||
'uni_state': broadband.get('UNI Status', ''),
|
||||
'line_speed_mbps': _to_int(broadband.get('Current Speed (Mbps)')),
|
||||
'optical_state': fiber.get('Optical WAN Operational Status', ''),
|
||||
'wavelength': fiber.get('Wave Length', ''),
|
||||
'optics_part_no': fiber.get('Vendor PN', ''),
|
||||
'optics': metrics,
|
||||
'counters': {k: _to_int(broadband.get(label)) for k, label in _COUNTERS.items()},
|
||||
}
|
||||
|
||||
# With a healthy link the optics must be readable; if not, the layout changed.
|
||||
# With a cut fiber they may legitimately be blank, so don't report that as invalid.
|
||||
if not wan_problems(data) and 'rx_power' not in metrics:
|
||||
raise ModemDataInvalid('link is up but no Rx power reading was found')
|
||||
return data
|
||||
|
||||
|
||||
def counter_rates(current: dict, previous: Optional[dict], elapsed_s: float) -> Dict[str, Optional[float]]:
|
||||
"""Return per-second rates between counter snapshots.
|
||||
|
||||
A rate is None rather than a bogus value on the first poll, or when a counter
|
||||
goes backwards because the gateway rebooted.
|
||||
"""
|
||||
rates: Dict[str, Optional[float]] = {}
|
||||
for key, now_val in current.items():
|
||||
then = (previous or {}).get(key)
|
||||
if now_val is None or then is None or elapsed_s <= 0 or now_val < then:
|
||||
rates[key] = None
|
||||
else:
|
||||
rates[key] = (now_val - then) / elapsed_s
|
||||
return rates
|
||||
|
||||
|
||||
class ModemClient:
|
||||
def __init__(self, cfg: dict):
|
||||
self.base_url = cfg['url'].rstrip('/')
|
||||
self.timeout = cfg.get('timeout', 10)
|
||||
self.session = requests.Session()
|
||||
|
||||
def _get(self, path: str) -> str:
|
||||
try:
|
||||
# Protected pages redirect or render a login form, so never follow redirects.
|
||||
resp = self.session.get(f'{self.base_url}{path}', timeout=self.timeout, allow_redirects=False)
|
||||
except requests.RequestException as e:
|
||||
raise ModemUnreachable(f'{path}: {e}') from e
|
||||
if resp.status_code != 200:
|
||||
raise ModemDataInvalid(f'{path} returned HTTP {resp.status_code}')
|
||||
if re.search(r'<title>\s*Login', resp.text, re.I):
|
||||
raise ModemDataInvalid(f'{path} now requires a login')
|
||||
return resp.text
|
||||
|
||||
def poll(self) -> dict:
|
||||
"""Return gateway status. Raises ModemUnreachable or ModemDataInvalid."""
|
||||
fiber = self._get(_FIBER_PAGE)
|
||||
broadband = self._get(_BROADBAND_PAGE)
|
||||
try:
|
||||
sysinfo = self._get(_SYSINFO_PAGE)
|
||||
except (ModemUnreachable, ModemDataInvalid) as e:
|
||||
# Model and uptime are nice to have, not worth failing the poll over.
|
||||
logger.warning(f'Modem system info unavailable: {e}')
|
||||
sysinfo = ''
|
||||
data = build_status(fiber, broadband, sysinfo)
|
||||
data['updated'] = datetime.now(timezone.utc).strftime('%Y-%m-%d %H:%M:%S UTC')
|
||||
return data
|
||||
|
||||
|
||||
# ---------------------------------------------------------------------------
|
||||
# WAN history: outages and gateway restarts, which are too brief to catch by polling
|
||||
# ---------------------------------------------------------------------------
|
||||
LOG_WAN_FAILED = 'NETWORK_WAN_FAILED_2'
|
||||
LOG_WAN_RESTORED = 'NETWORK_WAN_RESTORED_2'
|
||||
LOG_WAN_UNSTABLE = 'NETWORK_WAN_FAILED_MULTIPLE_TIMES_2'
|
||||
LOG_MODEM_RESTARTED = 'SMART_POWER_MODEM_RESTARTED'
|
||||
WAN_LOG_KEYS = (LOG_WAN_FAILED, LOG_WAN_RESTORED, LOG_WAN_UNSTABLE, LOG_MODEM_RESTARTED)
|
||||
|
||||
_HISTORY_LIMIT = 50
|
||||
# The RPDU's log entry and the gateway's calculated boot time can differ by this much.
|
||||
_RESTART_MATCH_WINDOW_S = 600
|
||||
|
||||
|
||||
def apply_wan_events(history: dict, events: List[dict]) -> List[dict]:
|
||||
"""Fold UniFi log events into *history* in place and return the ones worth a ticket.
|
||||
|
||||
Each event is {'key', 'ts' (epoch seconds), 'device', 'wan'}.
|
||||
"""
|
||||
outages = history.setdefault('outages', [])
|
||||
restarts = history.setdefault('restarts', [])
|
||||
actionable = []
|
||||
for e in sorted(events, key=lambda ev: ev['ts']):
|
||||
key = e['key']
|
||||
if key == LOG_WAN_FAILED:
|
||||
if not any(o.get('restored_at') is None for o in outages):
|
||||
outages.append({'failed_at': e['ts'], 'restored_at': None, 'wan': e.get('wan', '')})
|
||||
elif key == LOG_WAN_RESTORED:
|
||||
for o in reversed(outages):
|
||||
if o.get('restored_at') is None:
|
||||
o['restored_at'] = e['ts']
|
||||
break
|
||||
elif key == LOG_MODEM_RESTARTED:
|
||||
restarts.append({'at': e['ts'], 'by': e.get('device') or 'smart power', 'confirmed': False})
|
||||
actionable.append(e)
|
||||
elif key == LOG_WAN_UNSTABLE:
|
||||
actionable.append(e)
|
||||
del outages[:-_HISTORY_LIMIT]
|
||||
del restarts[:-_HISTORY_LIMIT]
|
||||
return actionable
|
||||
|
||||
|
||||
def record_uptime_reset(history: dict, boot_ts: float) -> None:
|
||||
"""Note that the gateway's uptime went backwards, attributing it to a logged restart if possible."""
|
||||
restarts = history.setdefault('restarts', [])
|
||||
for r in reversed(restarts):
|
||||
if abs(r['at'] - boot_ts) <= _RESTART_MATCH_WINDOW_S:
|
||||
r['confirmed'] = True
|
||||
return
|
||||
restarts.append({'at': boot_ts, 'by': None, 'confirmed': True})
|
||||
del restarts[:-_HISTORY_LIMIT]
|
||||
@@ -11,14 +11,18 @@ import json
|
||||
import logging
|
||||
import re
|
||||
import shlex
|
||||
import statistics
|
||||
import time
|
||||
from datetime import datetime, timezone
|
||||
from typing import Dict, List, Optional
|
||||
from urllib.parse import urlparse
|
||||
|
||||
import requests
|
||||
from urllib3.exceptions import InsecureRequestWarning
|
||||
|
||||
import db
|
||||
import devices
|
||||
import modem as modem_api
|
||||
|
||||
|
||||
logging.basicConfig(
|
||||
@@ -53,7 +57,8 @@ class PrometheusClient:
|
||||
def __init__(self, url: str):
|
||||
self.url = url.rstrip('/')
|
||||
|
||||
def query(self, promql: str) -> list:
|
||||
def _fetch(self, promql: str) -> Optional[list]:
|
||||
"""Return query results, or None if the query itself failed."""
|
||||
try:
|
||||
resp = requests.get(
|
||||
f'{self.url}/api/v1/query',
|
||||
@@ -64,13 +69,23 @@ class PrometheusClient:
|
||||
data = resp.json()
|
||||
if data.get('status') == 'success':
|
||||
return data['data']['result']
|
||||
logger.error(f'Prometheus query unsuccessful ({promql!r}): {data}')
|
||||
except Exception as e:
|
||||
logger.error(f'Prometheus query failed ({promql!r}): {e}')
|
||||
return []
|
||||
return None
|
||||
|
||||
def get_interface_states(self) -> Dict[str, Dict[str, bool]]:
|
||||
"""Return {instance: {device: is_up}} for physical interfaces."""
|
||||
results = self.query('node_network_up')
|
||||
def query(self, promql: str) -> list:
|
||||
return self._fetch(promql) or []
|
||||
|
||||
def get_interface_states(self) -> Optional[Dict[str, Dict[str, bool]]]:
|
||||
"""Return {instance: {device: is_up}} for physical interfaces.
|
||||
|
||||
Returns None when Prometheus can't answer or has no series at all, so
|
||||
callers can tell "we can't see anything" apart from "this host is gone".
|
||||
"""
|
||||
results = self._fetch('node_network_up')
|
||||
if not results:
|
||||
return None
|
||||
hosts: Dict[str, Dict[str, bool]] = {}
|
||||
for r in results:
|
||||
instance = r['metric'].get('instance', '')
|
||||
@@ -85,6 +100,10 @@ class PrometheusClient:
|
||||
# UniFi client
|
||||
# --------------------------------------------------------------------------
|
||||
class UnifiClient:
|
||||
# Devices whose port tables are collected: switches and the gateway/router
|
||||
_PORT_DEVICE_TYPES = ('usw', 'udm', 'ugw', 'uxg')
|
||||
_SYSTEM_LOG_MAX_PAGES = 10
|
||||
|
||||
def __init__(self, cfg: dict):
|
||||
self.base_url = cfg['controller']
|
||||
self.site_id = cfg.get('site_id', 'default')
|
||||
@@ -97,6 +116,111 @@ class UnifiClient:
|
||||
'Accept': 'application/json',
|
||||
}
|
||||
|
||||
def get_device_details(self) -> Optional[Dict[str, dict]]:
|
||||
"""Return firmware, load, WAN, and outlet details per device name.
|
||||
|
||||
Uses the v1 stat API, the only one that includes these fields.
|
||||
"""
|
||||
try:
|
||||
url = f'{self.base_url}/proxy/network/api/s/{self.site_id}/stat/device'
|
||||
resp = self.session.get(url, headers=self.headers, timeout=15)
|
||||
resp.raise_for_status()
|
||||
return {
|
||||
d.get('name') or d.get('mac', 'unknown'): self._device_detail(d)
|
||||
for d in resp.json().get('data', [])
|
||||
}
|
||||
except Exception as e:
|
||||
logger.error(f'UniFi device detail error: {e}')
|
||||
return None
|
||||
|
||||
@staticmethod
|
||||
def _device_detail(d: dict) -> dict:
|
||||
def number(raw) -> Optional[float]:
|
||||
try:
|
||||
return float(raw)
|
||||
except (TypeError, ValueError):
|
||||
return None
|
||||
|
||||
stats = d.get('system-stats') or {}
|
||||
wan = {}
|
||||
for key in ('wan1', 'wan2'):
|
||||
w = d.get(key) or {}
|
||||
if w:
|
||||
wan[key] = {
|
||||
'up': w.get('up'), 'speed_mbps': w.get('speed'),
|
||||
'latency_ms': w.get('latency'), 'availability': w.get('availability'),
|
||||
}
|
||||
return {
|
||||
'mac': d.get('mac', ''),
|
||||
'firmware': d.get('version', ''),
|
||||
'uptime_s': d.get('uptime'),
|
||||
'cpu_pct': number(stats.get('cpu')),
|
||||
'mem_pct': number(stats.get('mem')),
|
||||
'clients': d.get('num_sta'),
|
||||
'temps': [
|
||||
{'name': t.get('name', ''), 'value_c': number(t.get('value'))}
|
||||
for t in d.get('temperatures') or []
|
||||
],
|
||||
'wan': wan,
|
||||
'power_w': number(d.get('outlet_ac_power_consumption')),
|
||||
'outlets': [
|
||||
{
|
||||
'index': o.get('index'),
|
||||
'name': o.get('name', ''),
|
||||
'on': o.get('relay_state'),
|
||||
'auto_power_cycle': o.get('cycle_enabled'),
|
||||
'power_w': number(o.get('outlet_power')),
|
||||
'current_a': number(o.get('outlet_current')),
|
||||
}
|
||||
for o in d.get('outlet_table') or []
|
||||
],
|
||||
}
|
||||
|
||||
def get_wired_clients(self) -> List[dict]:
|
||||
"""Return wired clients as {mac, sw_mac, sw_port}; empty if unavailable."""
|
||||
try:
|
||||
url = f'{self.base_url}/proxy/network/api/s/{self.site_id}/stat/sta'
|
||||
resp = self.session.get(url, headers=self.headers, timeout=15)
|
||||
resp.raise_for_status()
|
||||
return [
|
||||
{'mac': c.get('mac', ''), 'sw_mac': c.get('sw_mac', ''), 'sw_port': c.get('sw_port')}
|
||||
for c in resp.json().get('data', []) if c.get('is_wired')
|
||||
]
|
||||
except Exception as e:
|
||||
logger.error(f'UniFi client list error: {e}')
|
||||
return []
|
||||
|
||||
def get_system_events(self, since_ms: int, keys: tuple) -> Optional[List[dict]]:
|
||||
"""Return system log entries with the given keys, or None if the log is unavailable."""
|
||||
url = f'{self.base_url}/proxy/network/v2/api/site/{self.site_id}/system-log/all'
|
||||
found: List[dict] = []
|
||||
try:
|
||||
for page in range(self._SYSTEM_LOG_MAX_PAGES):
|
||||
resp = self.session.post(
|
||||
url, headers=self.headers, timeout=20,
|
||||
json={
|
||||
'timestampFrom': since_ms, 'timestampTo': int(time.time() * 1000),
|
||||
'pageNumber': page, 'pageSize': 200,
|
||||
},
|
||||
)
|
||||
resp.raise_for_status()
|
||||
items = resp.json().get('data') or []
|
||||
if not items:
|
||||
break
|
||||
for e in items:
|
||||
if e.get('key') in keys and e.get('timestamp', 0) >= since_ms:
|
||||
params = e.get('parameters') or {}
|
||||
found.append({
|
||||
'key': e['key'], 'ts': e['timestamp'] / 1000,
|
||||
'device': (params.get('DEVICE') or {}).get('name', ''),
|
||||
'wan': (params.get('WAN_ID') or {}).get('name', '')
|
||||
or str((params.get('WAN_ID') or {}).get('id', '')),
|
||||
})
|
||||
return found
|
||||
except Exception as e:
|
||||
logger.error(f'UniFi system log error: {e}')
|
||||
return None
|
||||
|
||||
def get_devices(self) -> Optional[List[dict]]:
|
||||
"""Return list of UniFi devices, or None if the controller is unreachable."""
|
||||
try:
|
||||
@@ -122,7 +246,7 @@ class UnifiClient:
|
||||
return None
|
||||
|
||||
def get_switch_ports(self) -> Optional[Dict[str, dict]]:
|
||||
"""Return per-port stats for all UniFi switches, keyed by switch name.
|
||||
"""Return per-port stats for UniFi switches and routers, keyed by device name.
|
||||
|
||||
Uses the v1 stat API which includes full port_table data.
|
||||
Returns {switch_name: {'ip': str, 'model': str, 'ports': {port_name: {...}}}}.
|
||||
@@ -134,7 +258,7 @@ class UnifiClient:
|
||||
devices = resp.json().get('data', [])
|
||||
result: Dict[str, dict] = {}
|
||||
for dev in devices:
|
||||
if dev.get('type', '').lower() != 'usw':
|
||||
if dev.get('type', '').lower() not in self._PORT_DEVICE_TYPES:
|
||||
continue
|
||||
sw_name = dev.get('name') or dev.get('mac', 'unknown')
|
||||
sw_ip = dev.get('ip', '')
|
||||
@@ -143,7 +267,8 @@ class UnifiClient:
|
||||
# Build LLDP neighbor map (keyed by port_idx)
|
||||
lldp_map: Dict[int, dict] = {}
|
||||
for entry in dev.get('lldp_table', []):
|
||||
pidx = entry.get('lldp_port_idx')
|
||||
# Current UniFi Network versions use local_port_idx
|
||||
pidx = entry.get('local_port_idx', entry.get('lldp_port_idx'))
|
||||
if pidx is not None:
|
||||
lldp_map[int(pidx)] = {
|
||||
'chassis_id': entry.get('chassis_id', ''),
|
||||
@@ -321,13 +446,19 @@ class PulseClient:
|
||||
return self.run_command(command, _retry=False)
|
||||
return None
|
||||
|
||||
def ping(self, ip: str, count: int = 3, timeout: int = 2) -> bool:
|
||||
"""Ping *ip* via the Pulse worker. Returns True if host responds."""
|
||||
def ping(self, ip: str, count: int = 3, timeout: int = 2) -> Optional[bool]:
|
||||
"""Ping *ip* via the Pulse worker.
|
||||
|
||||
Returns True/False for the host's reachability, or None if Pulse itself
|
||||
couldn't run the check, which says nothing about the host.
|
||||
"""
|
||||
ip_q = shlex.quote(ip)
|
||||
output = self.run_command(
|
||||
f'ping -c {count} -W {timeout} {ip_q} >/dev/null 2>&1 && echo REACHABLE || echo UNREACHABLE'
|
||||
)
|
||||
return output is not None and output.strip() == 'REACHABLE'
|
||||
if output is None:
|
||||
return None
|
||||
return output.strip() == 'REACHABLE'
|
||||
|
||||
|
||||
# --------------------------------------------------------------------------
|
||||
@@ -615,18 +746,49 @@ class LinkStatsCollector:
|
||||
except Exception as e:
|
||||
logger.warning(f'UniFi switch port collection failed: {e}')
|
||||
|
||||
unifi_devices = (self.unifi.get_device_details() or {}) if self.unifi else {}
|
||||
self._resolve_neighbors(unifi_switches, unifi_devices, instance_map)
|
||||
|
||||
return {
|
||||
'hosts': result_hosts,
|
||||
'unifi_switches': unifi_switches,
|
||||
'unifi_devices': unifi_devices,
|
||||
'updated': datetime.now(timezone.utc).strftime('%Y-%m-%d %H:%M:%S UTC'),
|
||||
}
|
||||
|
||||
def _resolve_neighbors(self, switches: dict, unifi_devices: dict, instance_map: Dict[str, str]) -> None:
|
||||
"""Name port neighbors: UniFi's LLDP data has only MACs, and many servers send none."""
|
||||
host_macs: Dict[str, tuple] = {}
|
||||
host_ips: Dict[str, str] = {}
|
||||
# Bonds share their MAC with their member NICs, and LLDP runs on the NIC.
|
||||
results = sorted(
|
||||
self.prom.query('node_network_info'),
|
||||
key=lambda r: r['metric'].get('device', '').startswith('bond'),
|
||||
)
|
||||
for r in results:
|
||||
metric = r['metric']
|
||||
device, mac = metric.get('device', ''), metric.get('address', '').lower()
|
||||
instance = metric.get('instance', '')
|
||||
if not is_physical_interface(device) or not mac or mac == '00:00:00:00:00:00':
|
||||
continue
|
||||
ip = instance.split(':')[0]
|
||||
host = instance_map.get(instance, ip)
|
||||
host_macs.setdefault(mac, (host, device))
|
||||
host_ips[ip] = host
|
||||
device_macs = {
|
||||
info['mac'].lower(): name for name, info in unifi_devices.items() if info.get('mac')
|
||||
}
|
||||
devices.resolve_lldp_neighbors(switches, host_macs, device_macs, host_ips)
|
||||
devices.apply_client_locations(switches, self.unifi.get_wired_clients(), host_macs, device_macs)
|
||||
|
||||
def _compute_unifi_rates(self, raw: Dict[str, dict], now: float) -> Dict[str, dict]:
|
||||
"""Compute per-port byte/error rates from delta against previous snapshot."""
|
||||
dt = now - self._prev_unifi_time if self._prev_unifi_time > 0 else 0
|
||||
|
||||
def rate(new_val: int, old_val: int) -> Optional[float]:
|
||||
if dt <= 0:
|
||||
def rate(new_val: int, old_val: Optional[int]) -> Optional[float]:
|
||||
# No earlier reading (first poll, or a new/renamed port) means no rate,
|
||||
# not "all bytes since boot arrived in this one interval".
|
||||
if dt <= 0 or old_val is None:
|
||||
return None
|
||||
return max(0.0, (new_val - old_val) / dt)
|
||||
|
||||
@@ -637,12 +799,12 @@ class LinkStatsCollector:
|
||||
for pname, d in sw_data['ports'].items():
|
||||
entry = dict(d)
|
||||
prev = prev_ports.get(pname, {})
|
||||
entry['tx_bytes_rate'] = rate(d['tx_bytes'], prev.get('tx_bytes', 0))
|
||||
entry['rx_bytes_rate'] = rate(d['rx_bytes'], prev.get('rx_bytes', 0))
|
||||
entry['tx_errs_rate'] = rate(d['tx_errors'], prev.get('tx_errors', 0))
|
||||
entry['rx_errs_rate'] = rate(d['rx_errors'], prev.get('rx_errors', 0))
|
||||
entry['tx_drops_rate'] = rate(d['tx_dropped'], prev.get('tx_dropped', 0))
|
||||
entry['rx_drops_rate'] = rate(d['rx_dropped'], prev.get('rx_dropped', 0))
|
||||
entry['tx_bytes_rate'] = rate(d['tx_bytes'], prev.get('tx_bytes'))
|
||||
entry['rx_bytes_rate'] = rate(d['rx_bytes'], prev.get('rx_bytes'))
|
||||
entry['tx_errs_rate'] = rate(d['tx_errors'], prev.get('tx_errors'))
|
||||
entry['rx_errs_rate'] = rate(d['rx_errors'], prev.get('rx_errors'))
|
||||
entry['tx_drops_rate'] = rate(d['tx_dropped'], prev.get('tx_dropped'))
|
||||
entry['rx_drops_rate'] = rate(d['rx_dropped'], prev.get('rx_dropped'))
|
||||
merged_ports[pname] = entry
|
||||
result[sw_name] = {'ip': sw_data['ip'], 'model': sw_data['model'],
|
||||
'ports': merged_ports}
|
||||
@@ -682,9 +844,34 @@ class NetworkMonitor:
|
||||
# Use a separate, more forgiving threshold so those momentary reboots
|
||||
# don't cut tickets, while still catching genuine device failures.
|
||||
self.unifi_fail_thresh = mon.get('unifi_failure_threshold', self.fail_thresh)
|
||||
# A host's exporter stops as soon as a shutdown begins and a normal reboot
|
||||
# takes about 3-5 minutes, so wait longer than that before ticketing a host
|
||||
# that has disappeared. A NIC going down on a running host stays on fail_thresh.
|
||||
self.host_fail_thresh = mon.get('host_failure_threshold', 5)
|
||||
self.cluster_thresh = mon.get('cluster_threshold', 3)
|
||||
self.cluster_name = mon.get('cluster_name', CLUSTER_NAME)
|
||||
|
||||
# Optional WAN modem (AT&T BGW-series); see modem.py
|
||||
modem_cfg = self.cfg.get('modem') or {}
|
||||
self.modem = modem_api.ModemClient(modem_cfg) if modem_cfg.get('url') else None
|
||||
self.modem_name = modem_cfg.get('name', 'att-modem')
|
||||
# Modem reboots (including AT&T's automatic firmware updates) take a few
|
||||
# minutes, so this can be raised independently of failure_threshold.
|
||||
self.modem_fail_thresh = modem_cfg.get('failure_threshold', self.fail_thresh)
|
||||
self.rx_drift_db = modem_cfg.get('rx_drift_db', 3.0)
|
||||
self.rx_drift_min_samples = modem_cfg.get('rx_drift_min_samples', 288)
|
||||
self.modem_lan_ip = urlparse(modem_cfg['url']).hostname if modem_cfg.get('url') else ''
|
||||
self._prev_modem_counters: Optional[dict] = None
|
||||
self._prev_modem_time = 0.0
|
||||
if self.modem:
|
||||
try:
|
||||
db.ensure_modem_schema()
|
||||
except Exception as e:
|
||||
logger.error(f'Could not create modem history table: {e}')
|
||||
|
||||
# Last good Prometheus result, shown (as unknown) during a Prometheus outage
|
||||
self._last_iface_states: Dict[str, Dict[str, bool]] = {}
|
||||
|
||||
# Build Prometheus instance → hostname lookup
|
||||
self._instance_map: Dict[str, str] = {
|
||||
h['prometheus_instance']: h['name']
|
||||
@@ -744,6 +931,22 @@ class NetworkMonitor:
|
||||
if host_has_regression:
|
||||
hosts_with_regression.append(host)
|
||||
|
||||
# A dead host doesn't report its interfaces as down: its series just
|
||||
# disappear, so a configured host that's absent needs its own check.
|
||||
for instance, host in self._instance_map.items():
|
||||
if instance in states:
|
||||
db.resolve_event('host_metrics_missing', host, instance)
|
||||
continue
|
||||
hosts_with_regression.append(host)
|
||||
sup = db.check_suppressed(suppressions, 'host', host)
|
||||
event_id, is_new, consec, ticket_id = db.upsert_event(
|
||||
'host_metrics_missing', 'critical', 'prometheus',
|
||||
host, instance,
|
||||
f'No metrics from {host} ({instance}): host or node_exporter is down ({_now_utc()})',
|
||||
)
|
||||
if not sup and consec >= self.host_fail_thresh and not ticket_id:
|
||||
self._ticket_metrics_missing(event_id, host, instance, consec)
|
||||
|
||||
db.set_baseline(new_baseline)
|
||||
|
||||
# Cluster-wide check – only genuine regressions count
|
||||
@@ -752,7 +955,7 @@ class NetworkMonitor:
|
||||
event_id, is_new, consec, ticket_id = db.upsert_event(
|
||||
'cluster_network_issue', 'critical', 'prometheus',
|
||||
self.cluster_name, '',
|
||||
f'{len(hosts_with_regression)} hosts reporting simultaneous interface failures: '
|
||||
f'{len(hosts_with_regression)} hosts with simultaneous interface or metrics failures: '
|
||||
f'{", ".join(hosts_with_regression)}',
|
||||
)
|
||||
if not sup and (is_new or not ticket_id):
|
||||
@@ -765,7 +968,8 @@ class NetworkMonitor:
|
||||
f'Affected hosts: {", ".join(hosts_with_regression)}\n'
|
||||
f'Detected: {_now_utc()}\n\n'
|
||||
f'{len(hosts_with_regression)} Proxmox hosts simultaneously reported '
|
||||
f'interface regressions (link-down on interfaces previously known UP).\n'
|
||||
f'interface regressions (link-down on interfaces previously known UP) '
|
||||
f'or stopped reporting metrics.\n'
|
||||
f'This likely indicates a switch or upstream network failure.\n\n'
|
||||
f'Please check the core and management switches immediately.'
|
||||
)
|
||||
@@ -775,6 +979,54 @@ class NetworkMonitor:
|
||||
else:
|
||||
db.resolve_event('cluster_network_issue', self.cluster_name, '')
|
||||
|
||||
def _ticket_metrics_missing(
|
||||
self, event_id: int, host: str, instance: str, consec: int
|
||||
) -> None:
|
||||
title = (
|
||||
f'[{host}][auto][production][issue][network][single-node] '
|
||||
f'No metrics from host'
|
||||
)
|
||||
desc = (
|
||||
f'Host Metrics Alert\n{"=" * 40}\n\n'
|
||||
f'Host: {host}\n'
|
||||
f'Prometheus instance: {instance}\n'
|
||||
f'Detected: {_now_utc()}\n'
|
||||
f'Consecutive check failures: {consec}\n\n'
|
||||
f'Prometheus is working but has no node_network_up series for {host}.\n'
|
||||
f'Either the host is down or node_exporter has stopped on it.\n\n'
|
||||
f'Please check the host power and network connectivity, then '
|
||||
f'prometheus-node-exporter on the host.'
|
||||
)
|
||||
tid = self.tickets.create(title, desc, priority='2')
|
||||
if tid:
|
||||
db.set_ticket_id(event_id, tid)
|
||||
|
||||
def _process_prometheus_outage(self, suppressions: list) -> None:
|
||||
"""Interface and host alerts can't fire without Prometheus, so say so."""
|
||||
sup = db.check_suppressed(suppressions, 'host', 'prometheus')
|
||||
event_id, is_new, consec, ticket_id = db.upsert_event(
|
||||
'monitor_source_unavailable', 'critical', 'prometheus',
|
||||
'prometheus', '',
|
||||
f'Prometheus returned no interface data; host and interface alerting is paused ({_now_utc()})',
|
||||
)
|
||||
if not sup and consec >= self.fail_thresh and not ticket_id:
|
||||
title = (
|
||||
'[prometheus][auto][production][issue][network][cluster-wide] '
|
||||
'Gandalf has no Prometheus data'
|
||||
)
|
||||
desc = (
|
||||
f'Monitoring Source Alert\n{"=" * 40}\n\n'
|
||||
f'Prometheus URL: {self.prom.url}\n'
|
||||
f'Detected: {_now_utc()}\n'
|
||||
f'Consecutive check failures: {consec}\n\n'
|
||||
f'Gandalf could not get node_network_up data from Prometheus.\n'
|
||||
f'While this lasts, host and interface failures will NOT be detected.\n\n'
|
||||
f'Please check the Prometheus service and its scrape targets.'
|
||||
)
|
||||
tid = self.tickets.create(title, desc, priority='2')
|
||||
if tid:
|
||||
db.set_ticket_id(event_id, tid)
|
||||
|
||||
def _ticket_interface(
|
||||
self, event_id: int, host: str, iface: str, consec: int
|
||||
) -> None:
|
||||
@@ -842,10 +1094,15 @@ class NetworkMonitor:
|
||||
# ------------------------------------------------------------------
|
||||
# Ping-only hosts (no node_exporter)
|
||||
# ------------------------------------------------------------------
|
||||
def _process_ping_hosts(self, suppressions: list, ping_states: Dict[str, bool]) -> None:
|
||||
def _process_ping_hosts(self, suppressions: list, ping_states: Dict[str, Optional[bool]]) -> None:
|
||||
for h in self.cfg.get('monitor', {}).get('ping_hosts', []):
|
||||
name, ip = h['name'], h['ip']
|
||||
reachable = ping_states.get(name, False)
|
||||
reachable = ping_states.get(name)
|
||||
|
||||
if reachable is None:
|
||||
# Pulse couldn't run the check. Neither alert nor resolve on no evidence.
|
||||
logger.warning(f'Ping check for {name} ({ip}) unavailable this cycle')
|
||||
continue
|
||||
|
||||
if not reachable:
|
||||
sup = db.check_suppressed(suppressions, 'host', name)
|
||||
@@ -854,7 +1111,7 @@ class NetworkMonitor:
|
||||
name, ip,
|
||||
f'Host {name} ({ip}) unreachable via ping ({_now_utc()})',
|
||||
)
|
||||
if not sup and consec >= self.fail_thresh and not ticket_id:
|
||||
if not sup and consec >= self.host_fail_thresh and not ticket_id:
|
||||
self._ticket_unreachable(event_id, name, ip, consec)
|
||||
else:
|
||||
db.resolve_event('host_unreachable', name, ip)
|
||||
@@ -881,26 +1138,301 @@ class NetworkMonitor:
|
||||
if tid:
|
||||
db.set_ticket_id(event_id, tid)
|
||||
|
||||
# ------------------------------------------------------------------
|
||||
# WAN modem monitoring
|
||||
# ------------------------------------------------------------------
|
||||
_MODEM_METRIC_LABELS = {
|
||||
'rx_power': 'Rx power', 'tx_power': 'Tx power', 'temperature': 'Temperature',
|
||||
'vcc': 'Supply voltage', 'tx_bias': 'Tx bias',
|
||||
}
|
||||
_MODEM_METRIC_UNITS = {'rx_power': ' dBm', 'tx_power': ' dBm', 'temperature': ' C'}
|
||||
|
||||
def _modem_event(
|
||||
self, suppressions: list, event_type: str, severity: str, detail: str,
|
||||
description: str, heading: str, priority: str, advice: str,
|
||||
) -> None:
|
||||
name = self.modem_name
|
||||
sup = db.check_suppressed(suppressions, 'host', name)
|
||||
event_id, is_new, consec, ticket_id = db.upsert_event(
|
||||
event_type, severity, 'modem', name, detail, f'{description} ({_now_utc()})',
|
||||
)
|
||||
if not sup and consec >= self.modem_fail_thresh and not ticket_id:
|
||||
title = f'[{name}][auto][production][issue][network][cluster-wide] {heading}'
|
||||
desc = (
|
||||
f'WAN Modem Alert\n{"=" * 40}\n\n'
|
||||
f'Modem: {name} ({self.modem.base_url})\n'
|
||||
f'Detected: {_now_utc()}\n'
|
||||
f'Consecutive check failures: {consec}\n\n'
|
||||
f'{description}\n\n{advice}'
|
||||
)
|
||||
tid = self.tickets.create(title, desc, priority=priority)
|
||||
if tid:
|
||||
db.set_ticket_id(event_id, tid)
|
||||
|
||||
def _process_modem_failure(self, suppressions: list, error: Exception) -> None:
|
||||
"""Handle a failed poll. Link and optical events stay as they are: we can't see them."""
|
||||
name = self.modem_name
|
||||
if isinstance(error, modem_api.ModemUnreachable):
|
||||
db.resolve_event('modem_data_invalid', name, '')
|
||||
self._modem_event(
|
||||
suppressions, 'modem_unreachable', 'critical', '',
|
||||
f'WAN modem is not responding: {error}',
|
||||
'WAN modem unreachable', '2',
|
||||
'Internet access is probably affected too. Check modem power and the '
|
||||
'cable between the modem and the UDM-Pro.',
|
||||
)
|
||||
else:
|
||||
db.resolve_event('modem_unreachable', name, '')
|
||||
self._modem_event(
|
||||
suppressions, 'modem_data_invalid', 'warning', '',
|
||||
f'WAN modem status could not be read: {error}',
|
||||
'WAN modem status unreadable', '3',
|
||||
'The modem answered but its pages could not be parsed, so fiber alerting is '
|
||||
'paused. A firmware update may have changed them; see modem.py.',
|
||||
)
|
||||
|
||||
def _process_modem(self, data: dict, suppressions: list) -> None:
|
||||
"""Raise and resolve alerts from a successful modem poll."""
|
||||
name = self.modem_name
|
||||
db.resolve_event('modem_unreachable', name, '')
|
||||
db.resolve_event('modem_data_invalid', name, '')
|
||||
|
||||
problems = modem_api.wan_problems(data)
|
||||
if problems:
|
||||
self._modem_event(
|
||||
suppressions, 'wan_down', 'critical', '',
|
||||
f'WAN link is down: {"; ".join(problems)}.',
|
||||
'WAN link down', '1',
|
||||
'Check the fiber at the modem and the AT&T service status. Rx power at or below '
|
||||
'the alarm limit points to a fiber fault rather than a provider outage.',
|
||||
)
|
||||
else:
|
||||
db.resolve_event('wan_down', name, '')
|
||||
|
||||
for key, metric in data.get('optics', {}).items():
|
||||
status = modem_api.metric_status(metric)
|
||||
if status == 'alarm' and problems and key == 'rx_power':
|
||||
# wan_down already covers this, and a cut fiber would otherwise open two tickets.
|
||||
status = 'ok'
|
||||
label = self._MODEM_METRIC_LABELS.get(key, key)
|
||||
value = metric.get('value')
|
||||
reading = f' at {value}{self._MODEM_METRIC_UNITS.get(key, "")}' if value is not None else ''
|
||||
limits = (
|
||||
f' (warning {metric.get("warn_low")} to {metric.get("warn_high")}, '
|
||||
f'alarm {metric.get("alarm_low")} to {metric.get("alarm_high")})'
|
||||
) if value is not None else ''
|
||||
advice = (
|
||||
'Inspect and clean the fiber connector at the modem and look for tight bends. '
|
||||
'If that does not help, contact AT&T: the reading is what the modem measures '
|
||||
'on the provider side of the connection.'
|
||||
)
|
||||
|
||||
if status == 'alarm':
|
||||
db.resolve_event('fiber_signal_warning', name, key)
|
||||
self._modem_event(
|
||||
suppressions, 'fiber_signal_alarm', 'critical', key,
|
||||
f'{label} is in the alarm range{reading}{limits}.',
|
||||
f'Fiber {label} alarm', '2', advice,
|
||||
)
|
||||
elif status == 'warning':
|
||||
db.resolve_event('fiber_signal_alarm', name, key)
|
||||
self._modem_event(
|
||||
suppressions, 'fiber_signal_warning', 'warning', key,
|
||||
f'{label} is in the warning range{reading}{limits}.',
|
||||
f'Fiber {label} warning', '3', advice,
|
||||
)
|
||||
else:
|
||||
db.resolve_event('fiber_signal_alarm', name, key)
|
||||
db.resolve_event('fiber_signal_warning', name, key)
|
||||
|
||||
self._check_rx_drift(data, suppressions)
|
||||
|
||||
def _check_rx_drift(self, data: dict, suppressions: list) -> None:
|
||||
"""Alert on a sustained Rx drop relative to this link's own recent normal.
|
||||
|
||||
The modem's limits are very wide (warning at -27.9 dBm on a link that sits
|
||||
around -17), so a damaged connector could lose many dB before they trip.
|
||||
"""
|
||||
name = self.modem_name
|
||||
rx = (data.get('optics', {}).get('rx_power') or {}).get('value')
|
||||
if rx is None:
|
||||
return
|
||||
history = db.get_modem_rx_values(days=7)
|
||||
if len(history) < self.rx_drift_min_samples:
|
||||
return # not enough history yet to know what normal looks like
|
||||
baseline = statistics.median(history)
|
||||
drop = round(baseline - rx, 1)
|
||||
if drop >= self.rx_drift_db:
|
||||
self._modem_event(
|
||||
suppressions, 'fiber_rx_drift', 'warning', 'rx_power',
|
||||
f'Rx power is {rx} dBm, {drop} dB below its 7-day median of {baseline:.1f} dBm.',
|
||||
'Fiber Rx power dropped', '3',
|
||||
'The signal is still in range but has changed. Look for a recently disturbed '
|
||||
'or bent fiber and check the connector at the modem.',
|
||||
)
|
||||
else:
|
||||
db.resolve_event('fiber_rx_drift', name, 'rx_power')
|
||||
|
||||
def _load_wan_history(self) -> dict:
|
||||
raw = db.get_state('wan_history')
|
||||
if raw:
|
||||
try:
|
||||
return json.loads(raw)
|
||||
except ValueError:
|
||||
logger.error('Failed to parse wan_history JSON; starting over')
|
||||
return {'outages': [], 'restarts': []}
|
||||
|
||||
def _note_modem_restart(self, data: dict) -> None:
|
||||
uptime = data.get('uptime_s')
|
||||
if uptime is None:
|
||||
return
|
||||
previous = None
|
||||
raw = db.get_state('modem_stats')
|
||||
if raw:
|
||||
try:
|
||||
previous = json.loads(raw).get('uptime_s')
|
||||
except ValueError:
|
||||
logger.error('Failed to parse modem_stats JSON')
|
||||
if previous is not None and uptime < previous:
|
||||
logger.warning(f'Modem restarted: uptime went from {previous}s to {uptime}s')
|
||||
history = self._load_wan_history()
|
||||
modem_api.record_uptime_reset(history, time.time() - uptime)
|
||||
db.set_state('wan_history', history)
|
||||
|
||||
def _one_shot_ticket(
|
||||
self, suppressions: list, event_type: str, description: str,
|
||||
heading: str, priority: str, advice: str,
|
||||
) -> None:
|
||||
"""Report something that has already happened: open a ticket and resolve the event."""
|
||||
name = self.modem_name
|
||||
event_id, _, _, ticket_id = db.upsert_event(event_type, 'warning', 'unifi', name, '', description)
|
||||
if not db.check_suppressed(suppressions, 'host', name) and not ticket_id:
|
||||
tid = self.tickets.create(
|
||||
f'[{name}][auto][production][issue][network][cluster-wide] {heading}',
|
||||
f'WAN Event\n{"=" * 40}\n\nModem: {name}\nReported: {_now_utc()}\n\n{description}\n\n{advice}',
|
||||
priority=priority,
|
||||
)
|
||||
if tid:
|
||||
db.set_ticket_id(event_id, tid)
|
||||
db.resolve_event(event_type, name, '')
|
||||
|
||||
def _process_wan_log(self, suppressions: list) -> None:
|
||||
"""Read WAN outages and modem restarts from the UniFi log.
|
||||
|
||||
These can be over in two minutes, so a 5 minute poll of the modem may never see them.
|
||||
"""
|
||||
now = time.time()
|
||||
raw_cursor = db.get_state('unifi_log_cursor')
|
||||
if raw_cursor is None:
|
||||
# First run: start from now rather than ticketing old history.
|
||||
db.set_state('unifi_log_cursor', str(int(now * 1000)))
|
||||
return
|
||||
# After long monitor downtime, don't open tickets for stale events.
|
||||
since_ms = max(int(raw_cursor) + 1, int((now - 86400) * 1000))
|
||||
events = self.unifi.get_system_events(since_ms, modem_api.WAN_LOG_KEYS)
|
||||
if not events:
|
||||
return # None = log unavailable, so the cursor stays put and it's retried
|
||||
|
||||
history = self._load_wan_history()
|
||||
actionable = modem_api.apply_wan_events(history, events)
|
||||
|
||||
# UniFi repeats "failed multiple times" per failure, so ticket it once a day at most.
|
||||
unstable = [e for e in actionable if e['key'] == modem_api.LOG_WAN_UNSTABLE]
|
||||
ticket_unstable = bool(unstable) and now - history.get('unstable_ticketed_at', 0) >= 86400
|
||||
if ticket_unstable:
|
||||
history['unstable_ticketed_at'] = now
|
||||
|
||||
# Save first: a failed ticket call shouldn't replay these events next cycle.
|
||||
db.set_state('wan_history', history)
|
||||
db.set_state('unifi_log_cursor', str(int(max(e['ts'] for e in events) * 1000)))
|
||||
|
||||
for e in actionable:
|
||||
if e['key'] == modem_api.LOG_MODEM_RESTARTED:
|
||||
when = datetime.fromtimestamp(e['ts'], timezone.utc).strftime('%Y-%m-%d %H:%M:%S UTC')
|
||||
self._one_shot_ticket(
|
||||
suppressions, 'modem_power_cycled',
|
||||
f'{e.get("device") or "Smart Power"} power-cycled the modem at {when} '
|
||||
f'to try to restore the internet connection.',
|
||||
'Modem auto power-cycled after internet loss', '3',
|
||||
'The internet connection failed badly enough to trigger auto power-cycle. '
|
||||
'Check the WAN / Fiber panel for outages around this time and Rx power for a drop.',
|
||||
)
|
||||
if ticket_unstable:
|
||||
self._one_shot_ticket(
|
||||
suppressions, 'wan_unstable',
|
||||
'UniFi reports the WAN connection went down multiple times in the last 24 hours.',
|
||||
'WAN connection unstable', '2',
|
||||
'See the WAN history on the modem page. Repeated drops with healthy Rx power '
|
||||
'point toward the provider or the modem rather than the fiber.',
|
||||
)
|
||||
|
||||
def _collect_modem(self, suppressions: list) -> None:
|
||||
"""Poll the modem, then store its status and raise any alerts."""
|
||||
try:
|
||||
data = self.modem.poll()
|
||||
except (modem_api.ModemUnreachable, modem_api.ModemDataInvalid) as e:
|
||||
logger.warning(f'Modem poll failed: {e}')
|
||||
self._process_modem_failure(suppressions, e)
|
||||
db.set_state('modem_stats', {
|
||||
'reachable': False, 'error': str(e), 'name': self.modem_name,
|
||||
'lan_ip': self.modem_lan_ip, 'updated': _now_utc(),
|
||||
})
|
||||
return
|
||||
|
||||
# Uptime going backwards between polls means the gateway restarted, even if
|
||||
# it came back too quickly for any poll to fail. Read before it's overwritten.
|
||||
self._note_modem_restart(data)
|
||||
|
||||
now = time.monotonic()
|
||||
data['rates'] = modem_api.counter_rates(
|
||||
data['counters'], self._prev_modem_counters, now - self._prev_modem_time,
|
||||
)
|
||||
self._prev_modem_counters = data['counters']
|
||||
self._prev_modem_time = now
|
||||
data['reachable'] = True
|
||||
data['name'] = self.modem_name
|
||||
data['lan_ip'] = self.modem_lan_ip
|
||||
data['wan_problems'] = modem_api.wan_problems(data)
|
||||
data['optics_status'] = {k: modem_api.metric_status(m) for k, m in data['optics'].items()}
|
||||
db.set_state('modem_stats', data)
|
||||
|
||||
# Alert before recording, so a sudden drop isn't compared against itself.
|
||||
self._process_modem(data, suppressions)
|
||||
|
||||
optics = data['optics']
|
||||
db.record_modem_sample(
|
||||
(optics.get('rx_power') or {}).get('value'),
|
||||
(optics.get('tx_power') or {}).get('value'),
|
||||
(optics.get('temperature') or {}).get('value'),
|
||||
)
|
||||
|
||||
# ------------------------------------------------------------------
|
||||
# Snapshot collection (for dashboard)
|
||||
# ------------------------------------------------------------------
|
||||
def _collect_snapshot(
|
||||
self, iface_states: Dict[str, Dict[str, bool]],
|
||||
self, iface_states: Optional[Dict[str, Dict[str, bool]]],
|
||||
unifi_devices: Optional[List[dict]] = None,
|
||||
ping_states: Optional[Dict[str, bool]] = None,
|
||||
ping_states: Optional[Dict[str, Optional[bool]]] = None,
|
||||
) -> dict:
|
||||
# Accept pre-fetched devices; fall back to empty list if unavailable
|
||||
display_unifi = unifi_devices if unifi_devices is not None else []
|
||||
|
||||
# During a Prometheus outage keep showing the hosts, with their state unknown,
|
||||
# rather than emptying the dashboard or implying that they're down.
|
||||
prom_ok = iface_states is not None
|
||||
shown_states = iface_states if prom_ok else self._last_iface_states
|
||||
|
||||
hosts = {}
|
||||
for instance, ifaces in iface_states.items():
|
||||
for instance, ifaces in shown_states.items():
|
||||
if instance not in self._instance_map:
|
||||
continue # skip Prometheus instances not in config (e.g. LXC app servers)
|
||||
host = self._hostname(instance)
|
||||
phys = {k: v for k, v in ifaces.items()}
|
||||
up_count = sum(1 for v in phys.values() if v)
|
||||
total = len(phys)
|
||||
if total == 0 or up_count == total:
|
||||
if not prom_ok:
|
||||
status = 'unknown'
|
||||
elif total == 0 or up_count == total:
|
||||
status = 'up'
|
||||
elif up_count == 0:
|
||||
status = 'down'
|
||||
@@ -914,13 +1446,23 @@ class NetworkMonitor:
|
||||
'source': 'prometheus',
|
||||
}
|
||||
|
||||
# Configured hosts with no data: down if Prometheus is fine, otherwise unknown
|
||||
for instance, host in self._instance_map.items():
|
||||
if instance not in shown_states:
|
||||
hosts[host] = {
|
||||
'ip': instance.split(':')[0],
|
||||
'interfaces': {},
|
||||
'status': 'down' if prom_ok else 'unknown',
|
||||
'source': 'prometheus',
|
||||
}
|
||||
|
||||
for h in self.cfg.get('monitor', {}).get('ping_hosts', []):
|
||||
name, ip = h['name'], h['ip']
|
||||
reachable = (ping_states or {}).get(name, False)
|
||||
reachable = (ping_states or {}).get(name)
|
||||
hosts[name] = {
|
||||
'ip': ip,
|
||||
'interfaces': {},
|
||||
'status': 'up' if reachable else 'down',
|
||||
'status': 'unknown' if reachable is None else ('up' if reachable else 'down'),
|
||||
'source': 'ping',
|
||||
}
|
||||
|
||||
@@ -936,7 +1478,8 @@ class NetworkMonitor:
|
||||
def run(self) -> None:
|
||||
logger.info(
|
||||
f'Gandalf monitor started – poll_interval={self.poll_interval}s '
|
||||
f'fail_thresh={self.fail_thresh} unifi_fail_thresh={self.unifi_fail_thresh}'
|
||||
f'fail_thresh={self.fail_thresh} host_fail_thresh={self.host_fail_thresh} '
|
||||
f'unifi_fail_thresh={self.unifi_fail_thresh}'
|
||||
)
|
||||
while True:
|
||||
try:
|
||||
@@ -949,13 +1492,15 @@ class NetworkMonitor:
|
||||
unifi_devices = self.unifi.get_devices()
|
||||
|
||||
# 3a. Ping-only hosts once — shared by snapshot and alert processing
|
||||
ping_states: Dict[str, bool] = {
|
||||
ping_states: Dict[str, Optional[bool]] = {
|
||||
h['name']: self.pulse.ping(h['ip'])
|
||||
for h in self.cfg.get('monitor', {}).get('ping_hosts', [])
|
||||
}
|
||||
|
||||
# 3b. Collect and store snapshot for dashboard
|
||||
snapshot = self._collect_snapshot(iface_states, unifi_devices, ping_states)
|
||||
if iface_states is not None:
|
||||
self._last_iface_states = iface_states
|
||||
db.set_state('network_snapshot', snapshot)
|
||||
db.set_state('last_check', _now_utc())
|
||||
|
||||
@@ -968,14 +1513,29 @@ class NetworkMonitor:
|
||||
|
||||
# 5. Process alerts using already-fetched data
|
||||
suppressions = db.get_active_suppressions()
|
||||
self._process_interfaces(iface_states, suppressions)
|
||||
if iface_states is None:
|
||||
self._process_prometheus_outage(suppressions)
|
||||
else:
|
||||
db.resolve_event('monitor_source_unavailable', 'prometheus', '')
|
||||
self._process_interfaces(iface_states, suppressions)
|
||||
self._process_unifi(unifi_devices, suppressions)
|
||||
|
||||
self._process_ping_hosts(suppressions, ping_states)
|
||||
|
||||
# WAN modem: isolated so a failure here can't stop the rest of the cycle
|
||||
if self.modem:
|
||||
try:
|
||||
# Log first, so a restart it reports can explain an uptime reset below
|
||||
self._process_wan_log(suppressions)
|
||||
self._collect_modem(suppressions)
|
||||
except Exception as e:
|
||||
logger.error(f'Modem collection failed: {e}', exc_info=True)
|
||||
|
||||
# Housekeeping: deactivate expired suppressions and purge old resolved events
|
||||
db.cleanup_expired_suppressions()
|
||||
db.purge_old_resolved_events(days=90)
|
||||
if self.modem:
|
||||
db.purge_old_modem_samples(days=90)
|
||||
|
||||
logger.info('Network check cycle complete')
|
||||
|
||||
|
||||
@@ -46,6 +46,15 @@ CREATE TABLE IF NOT EXISTS suppression_rules (
|
||||
INDEX idx_sup_lookup (active, target_type, target_name, target_detail)
|
||||
) ENGINE=InnoDB;
|
||||
|
||||
-- ── WAN modem optical history (one row per poll) ──────────────────────
|
||||
-- Also created automatically at monitor startup (db.ensure_modem_schema).
|
||||
CREATE TABLE IF NOT EXISTS modem_samples (
|
||||
sampled_at TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP PRIMARY KEY,
|
||||
rx_power_dbm DECIMAL(5,1) NULL,
|
||||
tx_power_dbm DECIMAL(5,1) NULL,
|
||||
temp_c DECIMAL(5,1) NULL
|
||||
) ENGINE=InnoDB;
|
||||
|
||||
-- ── Monitor state (key/value store for snapshot + baseline) ───────────
|
||||
CREATE TABLE IF NOT EXISTS monitor_state (
|
||||
key_name VARCHAR(100) PRIMARY KEY,
|
||||
|
||||
@@ -0,0 +1,19 @@
|
||||
# Demo environment (for README screenshots)
|
||||
|
||||
Fictional data only (RFC 5737 documentation addresses). A throwaway MariaDB on loopback, the Flask app, and a tiny mock of the PULSE internal API so the **Run Diagnostics** button works.
|
||||
|
||||
```bash
|
||||
D=$(mktemp -d); rsync -a --exclude .git . $D/gandalf && cd $D
|
||||
mariadb-install-db --no-defaults --datadir=$D/db --auth-root-authentication-method=normal --skip-test-db
|
||||
mariadbd --no-defaults --datadir=$D/db --socket=$D/sock --port=3398 --bind-address=127.0.0.1 --user=root &
|
||||
mariadb --no-defaults -S $D/sock -e "CREATE USER 'gandalf'@'127.0.0.1' IDENTIFIED BY 'demo-only'" < /dev/null
|
||||
mariadb --no-defaults -S $D/sock < gandalf/schema.sql
|
||||
mariadb --no-defaults -S $D/sock -e "GRANT ALL ON gandalf.* TO 'gandalf'@'127.0.0.1'"
|
||||
# gandalf/config.json: database -> 127.0.0.1:3398 gandalf/demo-only; pulse.url -> http://127.0.0.1:8650 (api_key/worker_id any value)
|
||||
python3 gandalf/scripts/demo/seed.py # events, suppressions, snapshot and link stats
|
||||
python3 gandalf/scripts/demo/mock_pulse.py & # canned diagnostics output
|
||||
(cd gandalf && gunicorn -b 127.0.0.1:8500 app:app) &
|
||||
python3 gandalf/scripts/demo/capture.py # screenshots + GIF -> docs/img/
|
||||
```
|
||||
|
||||
The app trusts Authelia `Remote-User` / `Remote-Groups` headers, so `capture.py` sends them directly. Requires `playwright` and `pillow`.
|
||||
@@ -0,0 +1,159 @@
|
||||
"""Regenerates docs/img/* from a LOCAL demo instance (fictional data). See README.md in this folder."""
|
||||
|
||||
# flake8: noqa: E501 (demo data and canned output contain long literal lines)
|
||||
|
||||
import asyncio
|
||||
import io
|
||||
import pathlib
|
||||
import sys
|
||||
from urllib.parse import quote
|
||||
|
||||
from PIL import Image
|
||||
from playwright.async_api import async_playwright
|
||||
|
||||
OUT = str(pathlib.Path(__file__).resolve().parents[2] / "docs" / "img")
|
||||
B = "http://127.0.0.1:8500"
|
||||
H = {
|
||||
"Remote-User": "alex.rivera",
|
||||
"Remote-Name": "Alex Rivera",
|
||||
"Remote-Email": "alex@example.com",
|
||||
"Remote-Groups": "admin",
|
||||
}
|
||||
TOP = (
|
||||
"document.activeElement&&document.activeElement.blur();"
|
||||
"document.documentElement.style.scrollBehavior='auto';window.scrollTo(0,0)"
|
||||
)
|
||||
AV = (
|
||||
'<svg xmlns="http://www.w3.org/2000/svg" width="64" height="64">'
|
||||
'<rect width="64" height="64" fill="#050a10"/>'
|
||||
'<text x="32" y="40" font-family="monospace" font-size="24" font-weight="700" fill="#00d4ff" text-anchor="middle">AR</text></svg>'
|
||||
)
|
||||
|
||||
|
||||
async def mk(p, theme="dark", w=1440, h=900):
|
||||
b = await p.chromium.launch()
|
||||
c = await b.new_context(viewport={"width": w, "height": h}, extra_http_headers=H)
|
||||
await c.add_init_script(f"try{{localStorage.setItem('lt_theme','{theme}')}}catch(e){{}}")
|
||||
|
||||
async def av(route):
|
||||
await route.fulfill(status=200, content_type="image/svg+xml", body=AV)
|
||||
|
||||
await c.route("**/api/avatar*", av)
|
||||
return b, c
|
||||
|
||||
|
||||
async def go(pg, path, wait=5500):
|
||||
await pg.goto(B + path)
|
||||
await pg.wait_for_timeout(wait)
|
||||
await pg.evaluate(TOP)
|
||||
await pg.wait_for_timeout(300)
|
||||
|
||||
|
||||
async def el(pg, sel, name, idx=0):
|
||||
loc = pg.locator(sel).nth(idx)
|
||||
await loc.scroll_into_view_if_needed()
|
||||
await pg.wait_for_timeout(300)
|
||||
await loc.screenshot(path=f"{OUT}/{name}.png")
|
||||
print(name, "ok")
|
||||
|
||||
|
||||
async def select_port(pg, sw, idx):
|
||||
await pg.locator(f'[data-action="select-port"][data-switch="{sw}"][data-port-idx="{idx}"]').first.click()
|
||||
await pg.wait_for_timeout(1200)
|
||||
|
||||
|
||||
async def shots():
|
||||
async with async_playwright() as p:
|
||||
b, c = await mk(p)
|
||||
pg = await c.new_page()
|
||||
errs = []
|
||||
pg.on("pageerror", lambda e: errs.append(str(e)[:100]))
|
||||
await go(pg, "/")
|
||||
await pg.screenshot(path=f"{OUT}/dashboard.png")
|
||||
print("dashboard ok")
|
||||
await el(pg, "#topology-diagram", "topology")
|
||||
await el(pg, ".lt-section-header >> text=ALERT QUEUE", "alerts-tmp") if False else None
|
||||
# host cards + unifi table via element crops
|
||||
hb = (
|
||||
await pg.locator("#hosts-grid, .host-grid, .hosts-grid").first.bounding_box()
|
||||
if await pg.locator("#hosts-grid, .host-grid, .hosts-grid").count()
|
||||
else None
|
||||
)
|
||||
if hb:
|
||||
await pg.locator("#hosts-grid, .host-grid, .hosts-grid").first.screenshot(path=f"{OUT}/host-cards.png")
|
||||
print("host-cards ok")
|
||||
await go(pg, "/device/large1")
|
||||
await pg.locator('.device-row-toggle[data-row="enp5s0"]').click()
|
||||
await pg.wait_for_timeout(300)
|
||||
await pg.screenshot(path=f"{OUT}/device-host.png", full_page=True)
|
||||
await go(pg, "/device/" + quote("Pro 24 PoE"))
|
||||
await pg.screenshot(path=f"{OUT}/device-switch.png", full_page=True)
|
||||
await go(pg, "/device/USW-Aggregation")
|
||||
await pg.screenshot(path=f"{OUT}/inspector.png")
|
||||
await select_port(pg, "USW-Aggregation", 4)
|
||||
await pg.screenshot(path=f"{OUT}/inspector-port.png", full_page=False)
|
||||
await pg.locator('[data-action="run-diagnostic"]').first.click()
|
||||
await pg.wait_for_timeout(9000)
|
||||
await pg.evaluate("document.getElementById('diag-results')?.scrollIntoView({block:'start'})")
|
||||
await pg.wait_for_timeout(600)
|
||||
await pg.screenshot(path=f"{OUT}/inspector-diagnostics.png")
|
||||
print("diagnostics ok")
|
||||
await go(pg, "/suppressions")
|
||||
await pg.screenshot(path=f"{OUT}/suppressions.png", full_page=True)
|
||||
print("errors", errs[:3])
|
||||
await b.close()
|
||||
b, c = await mk(p, "light")
|
||||
pg = await c.new_page()
|
||||
await go(pg, "/")
|
||||
await pg.screenshot(path=f"{OUT}/dashboard-light.png")
|
||||
await b.close()
|
||||
|
||||
|
||||
async def gif():
|
||||
frames = []
|
||||
async with async_playwright() as p:
|
||||
b, c = await mk(p, "dark", 1280, 720)
|
||||
pg = await c.new_page()
|
||||
|
||||
async def snap(n=1, ms=0):
|
||||
if ms:
|
||||
await pg.wait_for_timeout(ms)
|
||||
im = Image.open(io.BytesIO(await pg.screenshot())).convert("RGB").resize((960, 540), Image.LANCZOS)
|
||||
for _ in range(n):
|
||||
frames.append(im)
|
||||
|
||||
await go(pg, "/", 5000)
|
||||
await snap(3)
|
||||
await pg.mouse.wheel(0, 620)
|
||||
await snap(3, 600)
|
||||
await pg.mouse.wheel(0, 700)
|
||||
await snap(2, 600)
|
||||
await go(pg, "/device/large1", 4500)
|
||||
await snap(3)
|
||||
await pg.mouse.wheel(0, 500)
|
||||
await snap(2, 500)
|
||||
await go(pg, "/device/USW-Aggregation", 4000)
|
||||
await snap(2)
|
||||
await select_port(pg, "USW-Aggregation", 4)
|
||||
await snap(3)
|
||||
await pg.locator('[data-action="run-diagnostic"]').first.click()
|
||||
await snap(2, 1500)
|
||||
await snap(2, 7500)
|
||||
await pg.evaluate("document.getElementById('diag-results')?.scrollIntoView({block:'start'})")
|
||||
await snap(4, 600)
|
||||
await go(pg, "/suppressions", 4000)
|
||||
await snap(3)
|
||||
await b.close()
|
||||
pal = [f.quantize(colors=96, method=Image.MEDIANCUT, dither=Image.NONE) for f in frames]
|
||||
pal[0].save(f"{OUT}/demo.gif", save_all=True, append_images=pal[1:], duration=1100, loop=0, optimize=True)
|
||||
print("gif", len(frames))
|
||||
|
||||
|
||||
async def main():
|
||||
if "gif" not in sys.argv:
|
||||
await shots()
|
||||
if "shots" not in sys.argv:
|
||||
await gif()
|
||||
|
||||
|
||||
asyncio.run(main())
|
||||
@@ -0,0 +1,133 @@
|
||||
"""Minimal stand-in for the PULSE internal API, returning canned diagnostics output (fictional data)."""
|
||||
|
||||
# flake8: noqa: E501 (demo data and canned output contain long literal lines)
|
||||
|
||||
import json
|
||||
from http.server import BaseHTTPRequestHandler, HTTPServer
|
||||
|
||||
CANNED = """=== carrier ===
|
||||
1
|
||||
=== operstate ===
|
||||
up
|
||||
=== sysfs_stats ===
|
||||
rx_bytes:9183029113
|
||||
tx_bytes:7732918231
|
||||
rx_errors:14
|
||||
tx_errors:0
|
||||
rx_dropped:0
|
||||
tx_dropped:0
|
||||
rx_crc_errors:14
|
||||
rx_frame_errors:0
|
||||
rx_fifo_errors:0
|
||||
tx_carrier_errors:0
|
||||
collisions:0
|
||||
rx_missed_errors:0
|
||||
=== carrier_changes ===
|
||||
6
|
||||
=== ethtool ===
|
||||
Settings for enp5s0:
|
||||
Supported ports: [ FIBRE ]
|
||||
Supported link modes: 10000baseT/Full
|
||||
Speed: 10000Mb/s
|
||||
Duplex: Full
|
||||
Port: FIBRE
|
||||
PHYAD: 0
|
||||
Auto-negotiation: off
|
||||
Link detected: yes
|
||||
=== ethtool_driver ===
|
||||
driver: ixgbe
|
||||
version: 6.8.12-4-pve
|
||||
firmware-version: 0x800003e1, 1.3429.0
|
||||
bus-info: 0000:05:00.0
|
||||
=== ethtool_pause ===
|
||||
Pause parameters for enp5s0:
|
||||
Autonegotiate: off
|
||||
RX: off
|
||||
TX: off
|
||||
=== ethtool_ring ===
|
||||
Ring parameters for enp5s0:
|
||||
Pre-set maximums:
|
||||
RX: 8192
|
||||
RX Mini: n/a
|
||||
RX Jumbo: n/a
|
||||
TX: 8192
|
||||
Current hardware settings:
|
||||
RX: 512
|
||||
RX Mini: n/a
|
||||
RX Jumbo: n/a
|
||||
TX: 512
|
||||
=== ethtool_stats ===
|
||||
NIC statistics:
|
||||
rx_packets: 183029113
|
||||
tx_packets: 120918231
|
||||
rx_errors: 14
|
||||
tx_errors: 0
|
||||
rx_crc_errors: 14
|
||||
rx_missed_errors: 0
|
||||
tx_timeout_count: 0
|
||||
fdir_match: 41022
|
||||
tx_flow_control_xon: 0
|
||||
rx_flow_control_xon: 0
|
||||
=== ethtool_dom ===
|
||||
Identifier : 0x03 (SFP)
|
||||
Connector : 0x07 (LC)
|
||||
Vendor name : FS
|
||||
Vendor PN : SFP-10GSR-85
|
||||
Laser wavelength : 850nm
|
||||
Laser bias current : 6.100 mA
|
||||
Laser output power : 0.5530 mW / -2.57 dBm
|
||||
Receiver signal average optical power : 0.0120 mW / -19.21 dBm
|
||||
Module temperature : 47.50 degrees C / 117.50 degrees F
|
||||
Module voltage : 3.3120 V
|
||||
=== ip_link ===
|
||||
5: enp5s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc mq master vmbr1 state UP mode DEFAULT group default qlen 1000
|
||||
link/ether 02:00:5e:10:00:05 brd ff:ff:ff:ff:ff:ff
|
||||
RX: bytes packets errors dropped missed mcast
|
||||
9183029113 183029113 14 0 0 10234
|
||||
TX: bytes packets errors dropped carrier collsns
|
||||
7732918231 120918231 0 0 0 0
|
||||
=== ip_addr ===
|
||||
5: enp5s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc mq master vmbr1 state UP group default qlen 1000
|
||||
link/ether 02:00:5e:10:00:05 brd ff:ff:ff:ff:ff:ff
|
||||
=== ip_route ===
|
||||
=== dmesg ===
|
||||
[ 412.118233] ixgbe 0000:05:00.0 enp5s0: NIC Link is Up 10 Gbps, Flow Control: None
|
||||
[1188221.402917] ixgbe 0000:05:00.0 enp5s0: NIC Link is Down
|
||||
[1188224.190331] ixgbe 0000:05:00.0 enp5s0: NIC Link is Up 10 Gbps, Flow Control: None
|
||||
[2230418.550112] ixgbe 0000:05:00.0 enp5s0: Reset adapter
|
||||
[2230421.118904] ixgbe 0000:05:00.0 enp5s0: NIC Link is Up 10 Gbps, Flow Control: None
|
||||
=== lldpctl ===
|
||||
-------------------------------------------------------------------------------
|
||||
LLDP neighbors:
|
||||
-------------------------------------------------------------------------------
|
||||
Interface: enp5s0, via: LLDP, RID: 1, Time: 12 days, 03:11:42
|
||||
Chassis:
|
||||
ChassisID: mac aa:bb:cc:00:00:03
|
||||
SysName: USW-Aggregation
|
||||
Port:
|
||||
PortID: ifname Port 4
|
||||
=== end ===
|
||||
"""
|
||||
|
||||
|
||||
class H(BaseHTTPRequestHandler):
|
||||
def _send(self, obj, code=200):
|
||||
b = json.dumps(obj).encode()
|
||||
self.send_response(code)
|
||||
self.send_header("Content-Type", "application/json")
|
||||
self.send_header("Content-Length", str(len(b)))
|
||||
self.end_headers()
|
||||
self.wfile.write(b)
|
||||
|
||||
def do_POST(self):
|
||||
self.rfile.read(int(self.headers.get("Content-Length", 0) or 0))
|
||||
self._send({"execution_id": "demo-exec-0001"})
|
||||
|
||||
def do_GET(self):
|
||||
self._send({"status": "completed", "logs": [{"action": "command_result", "stdout": CANNED}]})
|
||||
|
||||
def log_message(self, *a):
|
||||
pass
|
||||
|
||||
|
||||
HTTPServer(("127.0.0.1", 8650), H).serve_forever()
|
||||
@@ -0,0 +1,425 @@
|
||||
"""Seed a throwaway GANDALF database with fictional data (documentation IP ranges only)."""
|
||||
|
||||
# flake8: noqa: E501 (demo data and canned output contain long literal lines)
|
||||
|
||||
import json
|
||||
import random
|
||||
from datetime import datetime, timedelta, timezone
|
||||
import pymysql
|
||||
|
||||
random.seed(11)
|
||||
conn = pymysql.connect(
|
||||
host="127.0.0.1",
|
||||
port=3398,
|
||||
user="gandalf",
|
||||
password="demo-only",
|
||||
database="gandalf",
|
||||
autocommit=True,
|
||||
charset="utf8mb4",
|
||||
)
|
||||
cur = conn.cursor()
|
||||
now = datetime.now(timezone.utc)
|
||||
|
||||
|
||||
def ts(h):
|
||||
return (now - timedelta(hours=h)).strftime("%Y-%m-%d %H:%M:%S")
|
||||
|
||||
|
||||
def state(k, v):
|
||||
cur.execute(
|
||||
"REPLACE INTO monitor_state (key_name,value) VALUES (%s,%s)", (k, v if isinstance(v, str) else json.dumps(v))
|
||||
)
|
||||
|
||||
|
||||
# ---- hosts / interfaces: (name, ip, [(iface, speed_mbps, up, kind)]) kind: rj45 | fiber | dac
|
||||
HOSTS = [
|
||||
(
|
||||
"compute-storage-01",
|
||||
"192.0.2.4",
|
||||
[("eno1", 1000, True, "rj45"), ("enp1s0f0", 10000, True, "dac"), ("enp1s0f1", 10000, True, "dac")],
|
||||
),
|
||||
("compute-storage-gpu-01", "192.0.2.10", [("enp2s0", 1000, True, "rj45"), ("enp4s0", 10000, True, "fiber")]),
|
||||
("large1", "192.0.2.2", [("enp3s0", 1000, True, "rj45"), ("enp5s0", 10000, True, "fiber")]),
|
||||
(
|
||||
"storage-01",
|
||||
"192.0.2.11",
|
||||
[("enp5s0", 1000, True, "rj45"), ("enp1s0", 10000, False, "fiber")],
|
||||
), # regression: link down
|
||||
(
|
||||
"micro1",
|
||||
"192.0.2.8",
|
||||
[("enp2s0", 1000, True, "rj45"), ("enp3s0", 1000, False, "rj45")],
|
||||
), # unused bond leg (baseline, not alerted)
|
||||
("monitor-02", "192.0.2.9", [("enp2s0", 1000, True, "rj45"), ("enp3s0", 1000, True, "rj45")]),
|
||||
]
|
||||
hosts = {}
|
||||
for name, ip, ifs in HOSTS:
|
||||
st = [u for _, _, u, _ in ifs]
|
||||
status = "up" if all(st) else ("down" if not any(st) else "degraded")
|
||||
hosts[name] = {
|
||||
"ip": ip,
|
||||
"interfaces": {i: ("up" if u else "down") for i, _, u, _ in ifs},
|
||||
"status": status,
|
||||
"source": "prometheus",
|
||||
}
|
||||
hosts["backup-01"] = {"ip": "198.51.100.20", "interfaces": {}, "status": "up", "source": "ping"}
|
||||
unifi = [
|
||||
{
|
||||
"name": "Dream Machine Pro",
|
||||
"mac": "aa:bb:cc:00:00:01",
|
||||
"ip": "192.0.2.1",
|
||||
"type": "udm",
|
||||
"model": "UDMPRO",
|
||||
"state": 1,
|
||||
"connected": True,
|
||||
},
|
||||
{
|
||||
"name": "Pro 24 PoE",
|
||||
"mac": "aa:bb:cc:00:00:02",
|
||||
"ip": "192.0.2.30",
|
||||
"type": "usw",
|
||||
"model": "US24PRO",
|
||||
"state": 1,
|
||||
"connected": True,
|
||||
},
|
||||
{
|
||||
"name": "USW-Aggregation",
|
||||
"mac": "aa:bb:cc:00:00:03",
|
||||
"ip": "192.0.2.31",
|
||||
"type": "usw",
|
||||
"model": "USL8A",
|
||||
"state": 1,
|
||||
"connected": True,
|
||||
},
|
||||
{
|
||||
"name": "UNVR Pro",
|
||||
"mac": "aa:bb:cc:00:00:04",
|
||||
"ip": "192.0.2.40",
|
||||
"type": "unvr",
|
||||
"model": "UNVRPRO",
|
||||
"state": 1,
|
||||
"connected": True,
|
||||
},
|
||||
{
|
||||
"name": "Garage AP",
|
||||
"mac": "aa:bb:cc:00:00:05",
|
||||
"ip": "192.0.2.41",
|
||||
"type": "uap",
|
||||
"model": "U6LR",
|
||||
"state": 0,
|
||||
"connected": False,
|
||||
},
|
||||
{
|
||||
"name": "Office AP",
|
||||
"mac": "aa:bb:cc:00:00:06",
|
||||
"ip": "192.0.2.42",
|
||||
"type": "uap",
|
||||
"model": "U6PRO",
|
||||
"state": 1,
|
||||
"connected": True,
|
||||
},
|
||||
]
|
||||
state("network_snapshot", {"hosts": hosts, "unifi": unifi, "updated": now.isoformat().replace("+00:00", "Z")})
|
||||
state("last_check", now.strftime("%Y-%m-%d %H:%M:%S UTC"))
|
||||
|
||||
|
||||
# ---- per-interface link stats
|
||||
def rate(speed, frac):
|
||||
return speed * 1e6 / 8 * frac
|
||||
|
||||
|
||||
link_hosts = {}
|
||||
for name, ip, ifs in HOSTS:
|
||||
d = {}
|
||||
for iface, speed, up, kind in ifs:
|
||||
e = {"host_ip": ip, "link_detected": up, "carrier_changes": random.choice([1, 2, 2, 3]) if up else 9}
|
||||
if up:
|
||||
f = random.uniform(0.01, 0.18) if speed == 1000 else random.uniform(0.04, 0.38)
|
||||
e.update(
|
||||
{
|
||||
"speed_mbps": speed,
|
||||
"duplex": "Full",
|
||||
"auto_neg": True,
|
||||
"tx_bytes_rate": rate(speed, f),
|
||||
"rx_bytes_rate": rate(speed, f * random.uniform(0.5, 1.4)),
|
||||
"tx_errs_rate": 0.0,
|
||||
"rx_errs_rate": 0.0,
|
||||
"tx_drops_rate": 0.0,
|
||||
"rx_drops_rate": 0.0,
|
||||
}
|
||||
)
|
||||
else:
|
||||
e.update(
|
||||
{
|
||||
"speed_mbps": None,
|
||||
"duplex": None,
|
||||
"auto_neg": True,
|
||||
"tx_bytes_rate": 0,
|
||||
"rx_bytes_rate": 0,
|
||||
"tx_errs_rate": 0,
|
||||
"rx_errs_rate": 0,
|
||||
"tx_drops_rate": 0,
|
||||
"rx_drops_rate": 0,
|
||||
}
|
||||
)
|
||||
if up and kind == "fiber":
|
||||
e["sfp"] = {
|
||||
"sfp_type": "SFP+ 10GBASE-SR",
|
||||
"vendor": "FS",
|
||||
"part_no": "SFP-10GSR-85",
|
||||
"temp_c": round(random.uniform(38, 47), 1),
|
||||
"tx_power_dbm": round(random.uniform(-2.8, -1.6), 2),
|
||||
"rx_power_dbm": round(random.uniform(-4.5, -3.0), 2),
|
||||
}
|
||||
if up and kind == "dac":
|
||||
e["sfp"] = {"sfp_type": "SFP+ passive DAC", "vendor": "Ubiquiti", "part_no": "UACC-DAC-SFP10-1M"}
|
||||
d[iface] = e
|
||||
link_hosts[name] = d
|
||||
# one marginal fibre (low RX power) for the warning colour
|
||||
link_hosts["large1"]["enp5s0"]["sfp"].update({"rx_power_dbm": -10.9, "temp_c": 58.4})
|
||||
link_hosts["large1"]["enp5s0"]["carrier_changes"] = 6
|
||||
|
||||
|
||||
# ---- UniFi switch ports (with LLDP neighbours = the hosts above)
|
||||
def port(idx, up, speed, sw_ip, uplink=False, media="GE", lldp=None, poe=None, frac=0.05):
|
||||
|
||||
def r():
|
||||
return rate(speed, frac * random.uniform(0.5, 1.5)) if up else 0
|
||||
|
||||
p = {
|
||||
"port_idx": idx,
|
||||
"switch_ip": sw_ip,
|
||||
"up": up,
|
||||
"speed_mbps": speed if up else 0,
|
||||
"full_duplex": up,
|
||||
"autoneg": True,
|
||||
"is_uplink": uplink,
|
||||
"media": media,
|
||||
"poe_power": poe[0] if poe else None,
|
||||
"poe_class": poe[1] if poe else None,
|
||||
"poe_max_power": poe[2] if poe else None,
|
||||
"poe_mode": "auto" if poe else "",
|
||||
"lldp": lldp,
|
||||
"tx_bytes": int(random.uniform(1e11, 9e12)) if up else 0,
|
||||
"rx_bytes": int(random.uniform(1e11, 9e12)) if up else 0,
|
||||
"tx_errors": 0,
|
||||
"rx_errors": 0,
|
||||
"tx_dropped": 0,
|
||||
"rx_dropped": 0,
|
||||
"tx_bytes_rate": r(),
|
||||
"rx_bytes_rate": r(),
|
||||
"tx_errs_rate": 0.0,
|
||||
"rx_errs_rate": 0.0,
|
||||
"tx_drops_rate": 0.0,
|
||||
"rx_drops_rate": 0.0,
|
||||
}
|
||||
return p
|
||||
|
||||
|
||||
def L(host, iface):
|
||||
return {
|
||||
"chassis_id": "aa:bb:cc:11:22:33",
|
||||
"system_name": host,
|
||||
"port_id": iface,
|
||||
"port_desc": iface,
|
||||
"mgmt_ips": [dict(HOSTS_IP)[host]] if False else [],
|
||||
}
|
||||
|
||||
|
||||
HOSTS_IP = {n: ip for n, ip, _ in HOSTS}
|
||||
pro = {}
|
||||
mgmt = [
|
||||
(1, "compute-storage-01", "eno1"),
|
||||
(2, "compute-storage-gpu-01", "enp2s0"),
|
||||
(3, "large1", "enp3s0"),
|
||||
(4, "storage-01", "enp5s0"),
|
||||
(5, "micro1", "enp2s0"),
|
||||
(6, "monitor-02", "enp2s0"),
|
||||
(7, "monitor-02", "enp3s0"),
|
||||
]
|
||||
for i in range(1, 25):
|
||||
m = [x for x in mgmt if x[0] == i]
|
||||
if m:
|
||||
pro[f"Port {i}"] = port(i, True, 1000, "192.0.2.30", lldp=L(m[0][1], m[0][2]), frac=0.06)
|
||||
elif i == 8:
|
||||
pro[f"Port {i}"] = port(i, False, 0, "192.0.2.30") # micro1 unused bond leg
|
||||
elif i in (10, 11, 12):
|
||||
pro[f"Port {i}"] = port(
|
||||
i,
|
||||
True,
|
||||
100 if i == 12 else 1000,
|
||||
"192.0.2.30",
|
||||
lldp=None,
|
||||
poe=(round(random.uniform(3, 9), 1), 4, 30.0),
|
||||
frac=0.02,
|
||||
) # APs / cameras on PoE
|
||||
elif i == 9:
|
||||
pro[f"Port {i}"] = port(
|
||||
i,
|
||||
True,
|
||||
1000,
|
||||
"192.0.2.30",
|
||||
lldp={
|
||||
"chassis_id": "aa:bb:cc:00:00:04",
|
||||
"system_name": "UNVR Pro",
|
||||
"port_id": "eth0",
|
||||
"port_desc": "eth0",
|
||||
"mgmt_ips": [],
|
||||
},
|
||||
poe=(0.0, 0, 30.0),
|
||||
frac=0.2,
|
||||
)
|
||||
else:
|
||||
pro[f"Port {i}"] = port(i, False, 0, "192.0.2.30")
|
||||
pro["Port 25"] = port(
|
||||
25,
|
||||
True,
|
||||
10000,
|
||||
"192.0.2.30",
|
||||
uplink=True,
|
||||
media="SFP+",
|
||||
lldp={
|
||||
"chassis_id": "aa:bb:cc:00:00:03",
|
||||
"system_name": "USW-Aggregation",
|
||||
"port_id": "Port 7",
|
||||
"port_desc": "Port 7",
|
||||
"mgmt_ips": [],
|
||||
},
|
||||
frac=0.08,
|
||||
)
|
||||
pro["Port 26"] = port(26, False, 0, "192.0.2.30", media="SFP+")
|
||||
agg = {}
|
||||
aggmap = [
|
||||
(1, "compute-storage-01", "enp1s0f0"),
|
||||
(2, "compute-storage-01", "enp1s0f1"),
|
||||
(3, "compute-storage-gpu-01", "enp4s0"),
|
||||
(4, "large1", "enp5s0"),
|
||||
(5, "storage-01", "enp1s0"),
|
||||
]
|
||||
for i in range(1, 9):
|
||||
m = [x for x in aggmap if x[0] == i]
|
||||
if i == 5:
|
||||
agg[f"Port {i}"] = port(i, False, 0, "192.0.2.31", media="SFP+", lldp=None) # storage-01 10G link is down
|
||||
elif m:
|
||||
agg[f"Port {i}"] = port(i, True, 10000, "192.0.2.31", media="SFP+", lldp=L(m[0][1], m[0][2]), frac=0.15)
|
||||
elif i == 7:
|
||||
agg[f"Port {i}"] = port(
|
||||
i,
|
||||
True,
|
||||
10000,
|
||||
"192.0.2.31",
|
||||
uplink=True,
|
||||
media="SFP+",
|
||||
lldp={
|
||||
"chassis_id": "aa:bb:cc:00:00:02",
|
||||
"system_name": "Pro 24 PoE",
|
||||
"port_id": "Port 25",
|
||||
"port_desc": "Port 25",
|
||||
"mgmt_ips": [],
|
||||
},
|
||||
frac=0.08,
|
||||
)
|
||||
else:
|
||||
agg[f"Port {i}"] = port(i, False, 0, "192.0.2.31", media="SFP+")
|
||||
state(
|
||||
"link_stats",
|
||||
{
|
||||
"hosts": link_hosts,
|
||||
"unifi_switches": {
|
||||
"Pro 24 PoE": {"ip": "192.0.2.30", "model": "US24PRO", "ports": pro},
|
||||
"USW-Aggregation": {"ip": "192.0.2.31", "model": "USL8A", "ports": agg},
|
||||
},
|
||||
"updated": now.strftime("%Y-%m-%d %H:%M:%S UTC"),
|
||||
},
|
||||
)
|
||||
|
||||
# ---- events
|
||||
EV = [ # type, sev, source, target, detail, desc, first_seen_h, last_seen_h, resolved_h|None, fails, ticket
|
||||
(
|
||||
"interface_down",
|
||||
"warning",
|
||||
"prometheus",
|
||||
"storage-01",
|
||||
"enp1s0",
|
||||
"Interface enp1s0 on storage-01 went down (UP -> DOWN regression).",
|
||||
3.2,
|
||||
0.0,
|
||||
None,
|
||||
5,
|
||||
"731905284",
|
||||
),
|
||||
(
|
||||
"unifi_device_offline",
|
||||
"warning",
|
||||
"unifi",
|
||||
"Garage AP",
|
||||
"uap / 192.0.2.41",
|
||||
'UniFi device "Garage AP" has been offline for 3 consecutive checks.',
|
||||
1.1,
|
||||
0.0,
|
||||
None,
|
||||
3,
|
||||
"731905301",
|
||||
),
|
||||
(
|
||||
"interface_down",
|
||||
"warning",
|
||||
"prometheus",
|
||||
"compute-storage-01",
|
||||
"enp1s0f1",
|
||||
"Interface enp1s0f1 on compute-storage-01 went down.",
|
||||
9.0,
|
||||
7.5,
|
||||
7.4,
|
||||
2,
|
||||
None,
|
||||
),
|
||||
(
|
||||
"host_unreachable",
|
||||
"warning",
|
||||
"ping",
|
||||
"backup-01",
|
||||
"198.51.100.20",
|
||||
"Host backup-01 stopped answering ping for 2 consecutive checks.",
|
||||
30.0,
|
||||
28.0,
|
||||
27.9,
|
||||
2,
|
||||
"731881772",
|
||||
),
|
||||
(
|
||||
"unifi_device_offline",
|
||||
"warning",
|
||||
"unifi",
|
||||
"Office AP",
|
||||
"uap / 192.0.2.42",
|
||||
'UniFi device "Office AP" was offline for 3 consecutive checks.',
|
||||
19.0,
|
||||
18.0,
|
||||
17.8,
|
||||
3,
|
||||
"731890014",
|
||||
),
|
||||
]
|
||||
for t, sev, src, tgt, det, desc, f, l, r, fails, tid in EV:
|
||||
cur.execute(
|
||||
"INSERT INTO network_events (event_type,severity,source_type,target_name,target_detail,description,first_seen,last_seen,resolved_at,consecutive_failures,ticket_id) VALUES (%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s)",
|
||||
(t, sev, src, tgt, det, desc, ts(f), ts(l), ts(r) if r is not None else None, fails, tid),
|
||||
)
|
||||
# ---- suppressions (one active timed, one manual, one expired in history)
|
||||
SUP = [
|
||||
("interface", "micro1", "enp3s0", "Unused bond leg, cable not connected", "alex.rivera", 48, None, 1),
|
||||
("host", "monitor-02", "", "Planned firmware update window", "alex.rivera", 0.4, 0.6, 1),
|
||||
("unifi_device", "Office AP", "", "Replacing the access point", "sam.chen", 30, 29, 0),
|
||||
]
|
||||
for tt, tn, td, reason, by, created_h, exp_in, active in SUP:
|
||||
exp = (
|
||||
(now + timedelta(hours=exp_in)).strftime("%Y-%m-%d %H:%M:%S")
|
||||
if exp_in and exp_in > 0
|
||||
else (ts(-exp_in) if exp_in else None)
|
||||
)
|
||||
cur.execute(
|
||||
"INSERT INTO suppression_rules (target_type,target_name,target_detail,reason,suppressed_by,created_at,expires_at,active) VALUES (%s,%s,%s,%s,%s,%s,%s,%s)",
|
||||
(tt, tn, td, reason, by, ts(created_h), exp, active),
|
||||
)
|
||||
print("seeded: hosts", len(hosts), "unifi", len(unifi), "events", len(EV), "suppressions", len(SUP))
|
||||
@@ -1,4 +1,6 @@
|
||||
'use strict';
|
||||
/* exported initDeviceSearch */
|
||||
/* global DEVICE_NAME */
|
||||
|
||||
// ── Auto-redirect on auth timeout ─────────────────────────────────────
|
||||
// Wraps fetch so a 401 (Authelia session expired) forces a full reload.
|
||||
@@ -40,6 +42,7 @@ async function refreshAll() {
|
||||
const [netResult, statusResult] = await Promise.allSettled([
|
||||
lt.api.get('/api/network'),
|
||||
lt.api.get('/api/status'),
|
||||
refreshModem(),
|
||||
]);
|
||||
if (netResult.status === 'fulfilled') {
|
||||
const net = netResult.value;
|
||||
@@ -170,6 +173,263 @@ function updateTopology(hosts) {
|
||||
});
|
||||
}
|
||||
|
||||
// ── Device search ─────────────────────────────────────────────────────
|
||||
function deviceUrl(name) {
|
||||
return `/device/${encodeURIComponent(name)}`;
|
||||
}
|
||||
|
||||
// All words must match somewhere; the device's name matching ranks first.
|
||||
function rankDevices(devices, query) {
|
||||
const words = query.trim().toLowerCase().split(/\s+/).filter(Boolean);
|
||||
if (!words.length) return [];
|
||||
const scored = [];
|
||||
for (const d of devices) {
|
||||
if (!words.every(w => d.search.includes(w))) continue;
|
||||
const name = d.name.toLowerCase();
|
||||
let score = 3;
|
||||
if (name === words[0]) score = 0;
|
||||
else if (name.startsWith(words[0])) score = 1;
|
||||
else if (name.includes(words[0]) || (d.ip || '').startsWith(words[0])) score = 2;
|
||||
scored.push({ d, score });
|
||||
}
|
||||
return scored
|
||||
.sort((a, b) => a.score - b.score || a.d.name.localeCompare(b.d.name))
|
||||
.slice(0, 12)
|
||||
.map(s => s.d);
|
||||
}
|
||||
|
||||
function initDeviceSearch() {
|
||||
const input = document.getElementById('device-search-input');
|
||||
const results = document.getElementById('device-search-results');
|
||||
if (!input || !results) return;
|
||||
let devices = [];
|
||||
let matches = [];
|
||||
let active = 0;
|
||||
|
||||
async function loadDevices() {
|
||||
try {
|
||||
devices = (await lt.api.get('/api/devices')).devices || [];
|
||||
} catch (err) {
|
||||
console.warn('Device list unavailable', err);
|
||||
}
|
||||
}
|
||||
|
||||
function close() {
|
||||
results.hidden = true;
|
||||
input.setAttribute('aria-expanded', 'false');
|
||||
input.removeAttribute('aria-activedescendant');
|
||||
}
|
||||
|
||||
function render() {
|
||||
matches = rankDevices(devices, input.value);
|
||||
if (!input.value.trim()) { close(); return; }
|
||||
active = Math.min(active, Math.max(matches.length - 1, 0));
|
||||
results.hidden = false;
|
||||
input.setAttribute('aria-expanded', 'true');
|
||||
if (!matches.length) {
|
||||
results.innerHTML = '<div class="device-search-empty">No devices match.</div>';
|
||||
input.removeAttribute('aria-activedescendant');
|
||||
return;
|
||||
}
|
||||
results.innerHTML = matches.map((d, i) => `
|
||||
<a class="device-search-row${i === active ? ' is-active' : ''}" id="device-opt-${i}" role="option"
|
||||
aria-selected="${i === active}" href="${lt.escHtml(deviceUrl(d.name))}">
|
||||
<span class="dot-${lt.escHtml(d.status)}"></span>
|
||||
<span class="device-search-name">${lt.escHtml(d.name)}</span>
|
||||
<span class="device-search-kind">${lt.escHtml(d.kind)}</span>
|
||||
<span class="device-search-meta">${lt.escHtml(d.ip || '')}</span>
|
||||
<span class="device-search-meta">${lt.escHtml(d.model || '')}</span>
|
||||
</a>`).join('');
|
||||
input.setAttribute('aria-activedescendant', `device-opt-${active}`);
|
||||
}
|
||||
|
||||
input.addEventListener('input', () => { active = 0; render(); });
|
||||
input.addEventListener('focus', () => { loadDevices().then(render); });
|
||||
input.addEventListener('keydown', e => {
|
||||
if (e.key === 'Escape') { close(); return; }
|
||||
if (!matches.length) return;
|
||||
if (e.key === 'ArrowDown') { e.preventDefault(); active = (active + 1) % matches.length; render(); }
|
||||
if (e.key === 'ArrowUp') { e.preventDefault(); active = (active - 1 + matches.length) % matches.length; render(); }
|
||||
if (e.key === 'Enter') { e.preventDefault(); window.location.href = deviceUrl(matches[active].name); }
|
||||
});
|
||||
document.addEventListener('click', e => {
|
||||
if (!e.target.closest('#device-search')) close();
|
||||
});
|
||||
document.addEventListener('keydown', e => {
|
||||
const typing = e.target.closest('input, textarea, select, [contenteditable]');
|
||||
if (e.key === '/' && !typing && !e.ctrlKey && !e.metaKey) {
|
||||
e.preventDefault();
|
||||
input.focus();
|
||||
}
|
||||
});
|
||||
loadDevices();
|
||||
}
|
||||
|
||||
// ── WAN modem / fiber panel ───────────────────────────────────────────
|
||||
async function refreshModem() {
|
||||
try {
|
||||
updateModem(await lt.api.get('/api/modem'));
|
||||
} catch (err) {
|
||||
console.warn('Modem data unavailable', err);
|
||||
}
|
||||
}
|
||||
|
||||
function _modemUptime(seconds) {
|
||||
if (seconds === null || seconds === undefined) return '–';
|
||||
const d = Math.floor(seconds / 86400);
|
||||
const h = Math.floor((seconds % 86400) / 3600);
|
||||
const m = Math.floor((seconds % 3600) / 60);
|
||||
return d ? `${d}d ${h}h` : `${h}h ${m}m`;
|
||||
}
|
||||
|
||||
function _modemRate(bytesPerSec) {
|
||||
if (bytesPerSec === null || bytesPerSec === undefined) return '–';
|
||||
const mbps = bytesPerSec * 8 / 1e6;
|
||||
return mbps >= 1000 ? `${(mbps / 1000).toFixed(2)} Gbps` : `${mbps.toFixed(1)} Mbps`;
|
||||
}
|
||||
|
||||
function _modemStat(label, value, cls, note) {
|
||||
return `
|
||||
<div class="modem-stat">
|
||||
<span class="modem-stat-label">${lt.escHtml(label)}</span>
|
||||
<span class="modem-stat-value ${cls || ''}">${lt.escHtml(String(value))}</span>
|
||||
${note ? `<span class="modem-stat-note">${lt.escHtml(note)}</span>` : ''}
|
||||
</div>`;
|
||||
}
|
||||
|
||||
function _modemOptic(label, metric, status, unit) {
|
||||
if (!metric || metric.value === null || metric.value === undefined) return _modemStat(label, '–');
|
||||
const cls = { alarm: 'lt-text-red', warning: 'lt-text-amber', ok: 'lt-text-green' }[status] || '';
|
||||
return _modemStat(label, `${metric.value} ${unit}`, cls, `warn ${metric.warn_low} to ${metric.warn_high}`);
|
||||
}
|
||||
|
||||
function _modemChart(history) {
|
||||
const points = (history || []).filter(p => p.rx_avg !== null && p.rx_avg !== undefined);
|
||||
if (points.length < 2) {
|
||||
return '<div class="modem-chart-empty">Rx power trend appears after a few polls.</div>';
|
||||
}
|
||||
const W = 600, H = 70, PAD = 4;
|
||||
const values = points.map(p => p.rx_avg);
|
||||
const low = Math.min(...values) - 0.5, high = Math.max(...values) + 0.5;
|
||||
const t0 = points[0].ts, tSpan = (points[points.length - 1].ts - t0) || 1;
|
||||
const coord = p => `${((p.ts - t0) / tSpan * W).toFixed(1)},` +
|
||||
`${(PAD + (high - p.rx_avg) / (high - low) * (H - 2 * PAD)).toFixed(1)}`;
|
||||
|
||||
// Break the line where samples are missing rather than drawing across an outage
|
||||
const gaps = points.slice(1).map((p, i) => p.ts - points[i].ts).sort((a, b) => a - b);
|
||||
const maxGap = gaps[Math.floor(gaps.length / 2)] * 3;
|
||||
const segments = [[]];
|
||||
points.forEach((p, i) => {
|
||||
if (i && p.ts - points[i - 1].ts > maxGap) segments.push([]);
|
||||
segments[segments.length - 1].push(coord(p));
|
||||
});
|
||||
const lines = segments
|
||||
.map(s => `<polyline points="${s.join(' ')}" fill="none" vector-effect="non-scaling-stroke"/>`)
|
||||
.join('');
|
||||
const summary = `range ${Math.min(...values)} to ${Math.max(...values)} dBm`;
|
||||
return `
|
||||
<div class="modem-chart">
|
||||
<div class="modem-chart-title">Rx power, last 7 days <span>${lt.escHtml(summary)}</span></div>
|
||||
<svg viewBox="0 0 ${W} ${H}" preserveAspectRatio="none" role="img"
|
||||
aria-label="Rx power trend, ${lt.escHtml(summary)}">${lines}</svg>
|
||||
</div>`;
|
||||
}
|
||||
|
||||
function _modemWhen(epochSeconds) {
|
||||
return new Date(epochSeconds * 1000).toLocaleString([], { dateStyle: 'short', timeStyle: 'short' });
|
||||
}
|
||||
|
||||
function _modemLastRestart(history) {
|
||||
const restarts = (history && history.restarts) || [];
|
||||
if (!restarts.length) return '';
|
||||
const last = restarts[restarts.length - 1];
|
||||
return `restarted ${_modemWhen(last.at)}${last.by ? ` by ${last.by}` : ''}`;
|
||||
}
|
||||
|
||||
function _modemDuration(seconds) {
|
||||
if (seconds < 60) return `${Math.round(seconds)}s`;
|
||||
if (seconds < 3600) return `${Math.floor(seconds / 60)}m ${Math.round(seconds % 60)}s`;
|
||||
return `${Math.floor(seconds / 3600)}h ${Math.floor((seconds % 3600) / 60)}m`;
|
||||
}
|
||||
|
||||
function _modemOutages(history) {
|
||||
const outages = ((history && history.outages) || []).slice(-5).reverse();
|
||||
if (!outages.length) return '';
|
||||
const rows = outages.map(o => {
|
||||
const length = o.restored_at === null || o.restored_at === undefined
|
||||
? '<span class="lt-text-red">ongoing</span>'
|
||||
: lt.escHtml(_modemDuration(o.restored_at - o.failed_at));
|
||||
return `<li><span>${lt.escHtml(_modemWhen(o.failed_at))}</span><span>${length}</span></li>`;
|
||||
}).join('');
|
||||
return `
|
||||
<div class="modem-outages">
|
||||
<div class="modem-chart-title">Recent WAN outages</div>
|
||||
<ul>${rows}</ul>
|
||||
</div>`;
|
||||
}
|
||||
|
||||
function updateModem(data) {
|
||||
const section = document.getElementById('modem-section');
|
||||
const body = document.getElementById('modem-body');
|
||||
if (!section || !body) return;
|
||||
section.hidden = !data.configured;
|
||||
if (!data.configured) return;
|
||||
|
||||
// On the dashboard, link to the modem's page. On that page, it would link to itself.
|
||||
const detailsLink = document.getElementById('modem-device-link');
|
||||
if (detailsLink && typeof DEVICE_NAME === 'undefined' && data.name) {
|
||||
detailsLink.href = deviceUrl(data.name);
|
||||
detailsLink.hidden = false;
|
||||
}
|
||||
|
||||
const rxLabel = document.getElementById('topo-modem-rx');
|
||||
const topo = document.getElementById('topo-modem');
|
||||
const title = document.getElementById('modem-title');
|
||||
|
||||
if (!data.reachable) {
|
||||
if (rxLabel) rxLabel.textContent = 'unreachable';
|
||||
if (topo) topo.classList.add('topo-v2-status-down');
|
||||
body.innerHTML = `
|
||||
<div class="modem-error">Modem status unavailable: ${lt.escHtml(data.error || 'unknown error')}
|
||||
<span class="modem-stat-note">Last attempt ${lt.escHtml(data.updated || '–')}</span></div>
|
||||
${_modemChart(data.history)}`;
|
||||
return;
|
||||
}
|
||||
|
||||
const problems = data.wan_problems || [];
|
||||
const optics = data.optics || {};
|
||||
const status = data.optics_status || {};
|
||||
const counters = data.counters || {};
|
||||
const rates = data.rates || {};
|
||||
const rx = optics.rx_power ? optics.rx_power.value : null;
|
||||
|
||||
if (topo) topo.classList.toggle('topo-v2-status-down', problems.length > 0);
|
||||
if (rxLabel) rxLabel.textContent = (rx === null || rx === undefined) ? 'Rx –' : `Rx ${rx} dBm`;
|
||||
if (title) {
|
||||
title.textContent = [data.model || 'AT&T Gateway', data.firmware && `fw ${data.firmware}`]
|
||||
.filter(Boolean).join(' · ');
|
||||
}
|
||||
|
||||
const errs = (counters.rx_errors || 0) + (counters.tx_errors || 0);
|
||||
const drops = (counters.rx_drops || 0) + (counters.tx_drops || 0);
|
||||
body.innerHTML = `
|
||||
${problems.length ? `<div class="modem-error">WAN down: ${lt.escHtml(problems.join('; '))}</div>` : ''}
|
||||
<div class="modem-stats">
|
||||
${_modemStat('WAN', problems.length ? 'DOWN' : 'UP', problems.length ? 'lt-text-red' : 'lt-text-green',
|
||||
data.wan_ip || '')}
|
||||
${_modemStat('PON', data.pon_state || '–', '', data.wavelength || '')}
|
||||
${_modemOptic('Rx power', optics.rx_power, status.rx_power, 'dBm')}
|
||||
${_modemOptic('Tx power', optics.tx_power, status.tx_power, 'dBm')}
|
||||
${_modemOptic('Optics temp', optics.temperature, status.temperature, '°C')}
|
||||
${_modemStat('Throughput', `↓ ${_modemRate(rates.rx_bytes)}`, '', `↑ ${_modemRate(rates.tx_bytes)}`)}
|
||||
${_modemStat('Errors / drops', `${errs} / ${drops}`, errs ? 'lt-text-amber' : '', 'since modem reboot')}
|
||||
${_modemStat('Uptime', _modemUptime(data.uptime_s), '', _modemLastRestart(data.wan_history))}
|
||||
</div>
|
||||
${_modemChart(data.history)}
|
||||
${_modemOutages(data.wan_history)}
|
||||
<div class="modem-stat-note modem-updated">Updated ${lt.escHtml(data.updated || '–')}</div>`;
|
||||
}
|
||||
|
||||
function updateUnifiTable(devices) {
|
||||
const tbody = document.querySelector('#unifi-table tbody');
|
||||
if (!tbody || !devices.length) return;
|
||||
@@ -188,7 +448,7 @@ function updateUnifiTable(devices) {
|
||||
return `
|
||||
<tr class="${statusClass}">
|
||||
<td><span class="${dotClass}"></span> ${statusText}</td>
|
||||
<td><strong>${lt.escHtml(d.name)}</strong></td>
|
||||
<td><a class="device-link" href="${lt.escHtml(deviceUrl(d.name))}"><strong>${lt.escHtml(d.name)}</strong></a></td>
|
||||
<td>${lt.escHtml(d.type)}</td>
|
||||
<td>${lt.escHtml(d.model)}</td>
|
||||
<td>${lt.escHtml(d.ip)}</td>
|
||||
|
||||
@@ -0,0 +1,422 @@
|
||||
'use strict';
|
||||
/* global DEVICE_NAME, deviceUrl, refreshModem, _toIso, fmtRate, fmtErrors, renderPortInspector, selectPortByIdx, highlightSelectedPort, FACEPLATES */
|
||||
|
||||
// Per-device page: overview, alerts, and a compact interface/port table. Host
|
||||
// rows expand in place; switch and router rows open the port inspector panel.
|
||||
|
||||
const esc = s => lt.escHtml(String(s === null || s === undefined ? '' : s));
|
||||
|
||||
const _openRows = new Set(); // survives auto-refresh
|
||||
let _filter = 'all';
|
||||
let _query = '';
|
||||
let _device = null;
|
||||
|
||||
// ── Formatting ───────────────────────────────────────────────────────
|
||||
function fmtSpeed(mbps) {
|
||||
if (!mbps) return '–';
|
||||
return mbps >= 1000 ? (mbps / 1000).toFixed(0) + ' Gbps' : mbps + ' Mbps';
|
||||
}
|
||||
|
||||
function fmtUnit(value, unit, digits) {
|
||||
return value === null || value === undefined ? '–' : `${value.toFixed(digits)} ${unit}`;
|
||||
}
|
||||
|
||||
function fmtUptime(seconds) {
|
||||
if (seconds === null || seconds === undefined) return '–';
|
||||
const d = Math.floor(seconds / 86400), h = Math.floor((seconds % 86400) / 3600);
|
||||
const m = Math.floor((seconds % 3600) / 60);
|
||||
return d ? `${d}d ${h}h` : `${h}h ${m}m`;
|
||||
}
|
||||
|
||||
function ratePct(bytesPerSec, mbps) {
|
||||
if (!mbps || !bytesPerSec) return 0;
|
||||
return Math.min(100, (bytesPerSec * 8 / 1e6 / mbps) * 100);
|
||||
}
|
||||
|
||||
function barClass(pct, isTx) {
|
||||
if (pct > 85) return 'lt-progress--red';
|
||||
if (pct > 65) return 'lt-progress--amber';
|
||||
return isTx ? '' : 'lt-progress--cyan';
|
||||
}
|
||||
|
||||
// ── SFP/DOM value classification ─────────────────────────────────────
|
||||
function rxClass(dbm) {
|
||||
if (dbm === null || dbm === undefined) return 'val-neutral';
|
||||
if (dbm < -15) return 'val-crit';
|
||||
return dbm < -10 ? 'val-warn' : 'val-good';
|
||||
}
|
||||
function txClass(dbm) {
|
||||
if (dbm === null || dbm === undefined) return 'val-neutral';
|
||||
return dbm < -5 ? 'val-crit' : 'val-good';
|
||||
}
|
||||
function tempClass(c) {
|
||||
if (c === null || c === undefined) return 'val-neutral';
|
||||
if (c > 80) return 'val-crit';
|
||||
return c > 70 ? 'val-warn' : 'val-good';
|
||||
}
|
||||
function voltClass(v) {
|
||||
if (v === null || v === undefined) return 'val-neutral';
|
||||
if (v < 3.0 || v > 3.6) return 'val-crit';
|
||||
return (v < 3.1 || v > 3.5) ? 'val-warn' : 'val-good';
|
||||
}
|
||||
|
||||
function powerFill(cls) {
|
||||
return cls === 'val-good' ? 'power-ok' : cls === 'val-warn' ? 'power-warn' : 'power-crit';
|
||||
}
|
||||
|
||||
function badges(d) {
|
||||
const out = [];
|
||||
if ((d.tx_errs_rate || 0) > 0.001 || (d.rx_errs_rate || 0) > 0.001) out.push('<span class="link-alert-badge">ERR</span>');
|
||||
if ((d.tx_drops_rate || 0) > 0.001 || (d.rx_drops_rate || 0) > 0.001) out.push('<span class="link-alert-badge link-alert-amber">DROP</span>');
|
||||
if ((d.carrier_changes || 0) > 3) out.push('<span class="link-alert-badge link-alert-amber">FLAP</span>');
|
||||
return out.join('');
|
||||
}
|
||||
|
||||
function stat(label, valueHtml, tooltip) {
|
||||
const tip = tooltip ? ` data-tooltip="${esc(tooltip)}"` : '';
|
||||
return `<div class="link-stat"><span class="link-stat-label"${tip}>${esc(label)}</span>` +
|
||||
`<span class="link-stat-value">${valueHtml}</span></div>`;
|
||||
}
|
||||
|
||||
function trafficBars(d) {
|
||||
const tx = ratePct(d.tx_bytes_rate, d.speed_mbps), rx = ratePct(d.rx_bytes_rate, d.speed_mbps);
|
||||
const row = (label, pct, rate, isTx) => `
|
||||
<div class="traffic-row">
|
||||
<span class="traffic-label">${label}</span>
|
||||
<div class="lt-progress ${barClass(pct, isTx)}"><div class="lt-progress-bar" style="width:${pct}%"></div></div>
|
||||
<span class="traffic-value">${fmtRate(rate)}</span>
|
||||
</div>`;
|
||||
return `<div class="traffic-section">${row('TX', tx, d.tx_bytes_rate, true)}${row('RX', rx, d.rx_bytes_rate, false)}</div>`;
|
||||
}
|
||||
|
||||
function sfpPanel(s) {
|
||||
if (!s || !Object.keys(s).length) return '';
|
||||
const rx = rxClass(s.rx_power_dbm), tx = txClass(s.tx_power_dbm);
|
||||
const has = v => v !== null && v !== undefined;
|
||||
const rxPct = has(s.rx_power_dbm) ? Math.min(100, Math.max(0, (s.rx_power_dbm + 20) / 15 * 100)) : 0;
|
||||
const txPct = has(s.tx_power_dbm) ? Math.min(100, Math.max(0, (s.tx_power_dbm + 10) / 8 * 100)) : 0;
|
||||
const item = (label, cls, value, tip, pct) => `
|
||||
<div class="sfp-stat">
|
||||
<span class="sfp-stat-label" data-tooltip="${esc(tip)}">${label}</span>
|
||||
<span class="sfp-stat-value ${cls}">${value}</span>
|
||||
${pct === undefined ? '' : `<div class="power-row"><div class="power-track"><div class="power-fill ${powerFill(cls)}" style="width:${pct}%"></div></div></div>`}
|
||||
</div>`;
|
||||
const vendor = [s.vendor, s.part_no, s.sfp_type, s.connector, s.wavelength_nm && `${s.wavelength_nm} nm`]
|
||||
.filter(Boolean).map(esc).join(' / ');
|
||||
return `
|
||||
<div class="sfp-panel">
|
||||
<div class="sfp-vendor-row">${vendor}</div>
|
||||
<div class="sfp-grid">
|
||||
${item('Temp', tempClass(s.temp_c), fmtUnit(s.temp_c, '°C', 1), 'Module temperature. Normal: below 70°C.')}
|
||||
${item('Voltage', voltClass(s.voltage_v), fmtUnit(s.voltage_v, 'V', 2), 'Supply voltage. Normal: 3.1–3.5 V.')}
|
||||
${item('Bias', '', fmtUnit(s.bias_ma, 'mA', 2), 'Laser bias current. High values may mean an aging laser.')}
|
||||
${item('TX Power', tx, fmtUnit(s.tx_power_dbm, 'dBm', 2), 'Optical transmit power.', txPct)}
|
||||
${item('RX Power', rx, fmtUnit(s.rx_power_dbm, 'dBm', 2), 'Optical receive power. Very low values may mean dirty or damaged fiber.', rxPct)}
|
||||
${has(s.rx_power_dbm) && has(s.tx_power_dbm) ? item('RX−TX Δ', '', `${(s.rx_power_dbm - s.tx_power_dbm).toFixed(2)} dBm`, 'Difference between receive and transmit power.') : ''}
|
||||
</div>
|
||||
</div>`;
|
||||
}
|
||||
|
||||
// ── Normalized rows, so hosts and switches share one table ───────────
|
||||
function hostRows(interfaces) {
|
||||
return Object.entries(interfaces)
|
||||
.sort(([a], [b]) => a.localeCompare(b, undefined, { numeric: true }))
|
||||
.map(([name, d]) => {
|
||||
const up = d.state ? d.state === 'up' : d.link_detected !== false;
|
||||
return {
|
||||
id: name, label: name, up, data: d, sub: d.port_type || '',
|
||||
detail: `
|
||||
<div class="link-stats-grid">
|
||||
${stat('Duplex', esc(d.duplex || '–'), 'Full = both directions at once. Half can cause collisions.')}
|
||||
${stat('Auto-neg', d.auto_neg === null || d.auto_neg === undefined ? '–' : d.auto_neg ? 'On' : 'Off')}
|
||||
${stat('Carrier Δ', d.carrier_changes === null || d.carrier_changes === undefined ? '–' : esc(d.carrier_changes), 'Times the link went up or down. High values mean flapping.')}
|
||||
${stat('TX Err/s', fmtErrors(d.tx_errs_rate))}
|
||||
${stat('RX Err/s', fmtErrors(d.rx_errs_rate))}
|
||||
${stat('TX Drop/s', fmtErrors(d.tx_drops_rate))}
|
||||
${stat('RX Drop/s', fmtErrors(d.rx_drops_rate))}
|
||||
</div>
|
||||
${trafficBars(d)}
|
||||
${sfpPanel(d.sfp)}`,
|
||||
};
|
||||
});
|
||||
}
|
||||
|
||||
function portRows(ports) {
|
||||
return Object.entries(ports)
|
||||
.sort(([, a], [, b]) => (a.port_idx || 0) - (b.port_idx || 0))
|
||||
.map(([name, d]) => {
|
||||
return {
|
||||
id: name, label: name, num: d.port_idx, up: !!d.up, data: d,
|
||||
neighbor: d.lldp ? { name: d.lldp.system_name, port: d.lldp.port_id, chassis: d.lldp.chassis_id } : null,
|
||||
sub: [d.is_uplink ? 'uplink' : '', d.media || '', d.poe_power ? `PoE ${d.poe_power.toFixed(1)} W` : ''].filter(Boolean).join(' · '),
|
||||
};
|
||||
});
|
||||
}
|
||||
|
||||
function rowHasProblem(r) {
|
||||
return !!badges(r.data);
|
||||
}
|
||||
|
||||
function renderTable(rows) {
|
||||
const q = _query.trim().toLowerCase();
|
||||
const shown = rows.filter(r => {
|
||||
if (_filter === 'up' && !r.up) return false;
|
||||
if (_filter === 'problems' && !rowHasProblem(r)) return false;
|
||||
return !q || `${r.label} ${r.num || ''} ${r.sub} ${(r.neighbor && r.neighbor.name) || ''}`.toLowerCase().includes(q);
|
||||
});
|
||||
if (!shown.length) return '<div class="lt-empty-state lt-empty-state--sm"><div class="lt-empty-state-title">Nothing matches this filter</div></div>';
|
||||
const isPorts = rows.some(r => r.num !== undefined);
|
||||
const body = shown.map(r => {
|
||||
const open = !isPorts && _openRows.has(r.id);
|
||||
const d = r.data;
|
||||
const neighbor = r.neighbor
|
||||
? (r.neighbor.name ? `<a class="device-link" href="${esc(deviceUrl(r.neighbor.name))}">${esc(r.neighbor.name)}</a>` : esc(r.neighbor.chassis || r.neighbor.port || ''))
|
||||
: '–';
|
||||
return `
|
||||
<tr class="device-row${r.up ? '' : ' device-row--down'}"${isPorts ? ` data-port-idx="${esc(r.num)}"` : ''}>
|
||||
<td><button type="button" class="device-row-toggle" data-row="${esc(r.id)}"${isPorts ? '' : ` aria-expanded="${open}"`} aria-label="Details for ${esc(r.label)}">${open ? '▾' : '▸'}</button></td>
|
||||
<td><span class="dot-${r.up ? 'up' : 'down'}"></span></td>
|
||||
<td class="device-row-name">${r.num !== undefined ? `<span class="port-badge port-badge-num">#${esc(r.num)}</span> ` : ''}${esc(r.label)}<div class="device-row-sub">${esc(r.sub)}</div></td>
|
||||
<td class="device-num">${r.up ? fmtSpeed(d.speed_mbps) : '–'}</td>
|
||||
<td class="device-num device-col-wide">${fmtRate(d.rx_bytes_rate)}</td>
|
||||
<td class="device-num device-col-wide">${fmtRate(d.tx_bytes_rate)}</td>
|
||||
${isPorts ? `<td class="device-col-wide">${neighbor}</td>` : ''}
|
||||
<td>${badges(d) || (r.up ? '<span class="val-good">OK</span>' : '<span class="device-row-sub">down</span>')}</td>
|
||||
</tr>
|
||||
${open ? `<tr class="device-row-detail"><td colspan="7">${r.detail}</td></tr>` : ''}`;
|
||||
}).join('');
|
||||
return `
|
||||
<div class="lt-table-wrap">
|
||||
<table class="lt-table device-table">
|
||||
<caption class="lt-sr-only">Interfaces</caption>
|
||||
<thead><tr>
|
||||
<th><span class="lt-sr-only">Expand</span></th><th><span class="lt-sr-only">State</span></th>
|
||||
<th>${isPorts ? 'Port' : 'Interface'}</th><th>Speed</th><th class="device-col-wide">RX</th><th class="device-col-wide">TX</th>
|
||||
${isPorts ? '<th class="device-col-wide">Neighbor</th>' : ''}<th>Health</th>
|
||||
</tr></thead>
|
||||
<tbody>${body}</tbody>
|
||||
</table>
|
||||
</div>`;
|
||||
}
|
||||
|
||||
function section(title, inner, id) {
|
||||
return `
|
||||
<section class="g-section"${id ? ` id="${id}"` : ''}>
|
||||
<div class="g-section-header"><h2 class="g-section-title">${esc(title)}</h2></div>
|
||||
<div class="lt-frame">
|
||||
<span class="lt-frame-bl">╚</span><span class="lt-frame-br">╝</span>
|
||||
${inner}
|
||||
</div>
|
||||
</section>`;
|
||||
}
|
||||
|
||||
function kvGrid(pairs) {
|
||||
return `<div class="modem-stats">${pairs.filter(([, v]) => v !== null && v !== undefined && v !== '').map(([k, v]) => `
|
||||
<div class="modem-stat"><span class="modem-stat-label">${esc(k)}</span><span class="modem-stat-value">${esc(v)}</span></div>`).join('')}</div>`;
|
||||
}
|
||||
|
||||
function renderOverview(d) {
|
||||
const info = d.info || {};
|
||||
const pct = v => (v === null || v === undefined ? null : `${v.toFixed(0)}%`);
|
||||
const temps = (info.temps || []).filter(t => t.value_c !== null).map(t => `${t.name} ${t.value_c.toFixed(0)}°C`).join(', ');
|
||||
return section('Overview', kvGrid([
|
||||
['Status', (d.status || 'unknown').toUpperCase()],
|
||||
['Type', d.kind],
|
||||
['IP', d.ip],
|
||||
['MAC', d.mac],
|
||||
['Model', d.model],
|
||||
['Firmware', info.firmware],
|
||||
['Uptime', info.uptime_s === undefined ? null : fmtUptime(info.uptime_s)],
|
||||
['CPU', pct(info.cpu_pct)],
|
||||
['Memory', pct(info.mem_pct)],
|
||||
['Clients', info.clients],
|
||||
['Temperature', temps],
|
||||
['Power draw', info.power_w === null || info.power_w === undefined ? null : `${info.power_w.toFixed(0)} W`],
|
||||
['Data source', d.source],
|
||||
]));
|
||||
}
|
||||
|
||||
function renderUplinks(d) {
|
||||
if (!(d.uplinks || []).length) return '';
|
||||
const rows = d.uplinks.map(u => `
|
||||
<tr>
|
||||
<td><span class="dot-${u.up ? 'up' : 'down'}"></span></td>
|
||||
<td>${esc(u.host_interface || '–')}</td>
|
||||
<td><a class="device-link" href="${esc(deviceUrl(u.switch))}">${esc(u.switch)}</a></td>
|
||||
<td><a class="device-link" href="${esc(deviceUrl(u.switch))}#port-${esc(u.port_idx)}">#${esc(u.port_idx)} ${esc(u.port)}</a></td>
|
||||
<td>${fmtSpeed(u.speed_mbps)}</td>
|
||||
</tr>`).join('');
|
||||
return section('Connected to', `<div class="lt-table-wrap"><table class="lt-table">
|
||||
<caption class="lt-sr-only">Switch ports this host connects to, from LLDP</caption>
|
||||
<thead><tr><th><span class="lt-sr-only">State</span></th><th>Interface</th><th>Switch</th><th>Port</th><th>Speed</th></tr></thead>
|
||||
<tbody>${rows}</tbody></table></div>`);
|
||||
}
|
||||
|
||||
function renderWan(d) {
|
||||
const wan = (d.info && d.info.wan) || {};
|
||||
const names = Object.keys(wan);
|
||||
if (!names.length) return '';
|
||||
const rows = names.map(n => {
|
||||
const w = wan[n];
|
||||
return `<tr><td><span class="dot-${w.up ? 'up' : 'down'}"></span></td><td>${esc(n.toUpperCase())}</td>
|
||||
<td>${fmtSpeed(w.speed_mbps)}</td><td>${w.latency_ms === null || w.latency_ms === undefined ? '–' : `${esc(w.latency_ms)} ms`}</td>
|
||||
<td>${w.availability === null || w.availability === undefined ? '–' : `${esc(w.availability)}%`}</td></tr>`;
|
||||
}).join('');
|
||||
return section('WAN', `<div class="lt-table-wrap"><table class="lt-table">
|
||||
<caption class="lt-sr-only">WAN connections</caption>
|
||||
<thead><tr><th><span class="lt-sr-only">State</span></th><th>Connection</th><th>Speed</th><th>Latency</th><th>Availability</th></tr></thead>
|
||||
<tbody>${rows}</tbody></table></div>`);
|
||||
}
|
||||
|
||||
function renderOutlets(d) {
|
||||
const outlets = (d.info && d.info.outlets) || [];
|
||||
if (!outlets.length) return '';
|
||||
const rows = outlets.map(o => `
|
||||
<tr>
|
||||
<td><span class="dot-${o.on ? 'up' : 'down'}"></span></td>
|
||||
<td>#${esc(o.index)}</td>
|
||||
<td>${esc(o.name || '–')}</td>
|
||||
<td class="device-num">${o.power_w === null || o.power_w === undefined ? '–' : `${o.power_w.toFixed(1)} W`}</td>
|
||||
<td>${o.auto_power_cycle ? '<span class="lt-badge">auto power-cycle</span>' : ''}</td>
|
||||
</tr>`).join('');
|
||||
return section('Outlets', `<div class="lt-table-wrap"><table class="lt-table">
|
||||
<caption class="lt-sr-only">PDU outlets</caption>
|
||||
<thead><tr><th><span class="lt-sr-only">State</span></th><th>Outlet</th><th>Name</th><th>Power</th><th></th></tr></thead>
|
||||
<tbody>${rows}</tbody></table></div>`);
|
||||
}
|
||||
|
||||
function renderEvents(events) {
|
||||
const body = !(events || []).length
|
||||
? '<div class="lt-empty-state lt-empty-state--sm"><div class="lt-empty-state-icon">✔</div><div class="lt-empty-state-title">No recorded alerts</div></div>'
|
||||
: `<div class="lt-table-wrap"><table class="lt-table">
|
||||
<caption class="lt-sr-only">Alerts for this device</caption>
|
||||
<thead><tr><th>Sev</th><th>Type</th><th>Detail</th><th>Description</th><th>First seen</th><th>State</th></tr></thead>
|
||||
<tbody>${events.map(e => `
|
||||
<tr class="${e.resolved_at ? '' : `row-${esc(e.severity)}`}">
|
||||
<td><span class="lt-badge badge-${e.resolved_at ? 'resolved' : esc(e.severity)}">${esc(e.severity)}</span>${e.is_suppressed && !e.resolved_at ? '<span class="lt-badge badge-suppressed">🔕 sup</span>' : ''}</td>
|
||||
<td>${esc(e.event_type.replace(/_/g, ' '))}</td>
|
||||
<td>${esc(e.target_detail || '–')}</td>
|
||||
<td class="desc-cell">${esc(e.description || '')}</td>
|
||||
<td class="ts-cell" title="${esc(e.first_seen || '')}">${esc(lt.time.ago(_toIso(e.first_seen)))}</td>
|
||||
<td>${e.resolved_at ? `resolved ${esc(lt.time.ago(_toIso(e.resolved_at)))}` : '<strong>active</strong>'}</td>
|
||||
</tr>`).join('')}</tbody></table></div>`;
|
||||
return section('Alerts', body);
|
||||
}
|
||||
|
||||
function currentRows() {
|
||||
if (!_device) return [];
|
||||
if (_device.ports) return portRows(_device.ports);
|
||||
if (_device.interfaces) return hostRows(_device.interfaces);
|
||||
return [];
|
||||
}
|
||||
|
||||
function renderInterfaces() {
|
||||
const wrap = document.getElementById('device-table-wrap');
|
||||
if (!wrap) return;
|
||||
wrap.innerHTML = renderTable(currentRows());
|
||||
highlightSelectedPort();
|
||||
}
|
||||
|
||||
function updateInterfaceSection(rows, title, hasChassis) {
|
||||
const section = document.getElementById('device-ports');
|
||||
section.hidden = !rows.length && !hasChassis;
|
||||
document.querySelector('.device-port-table').hidden = !rows.length;
|
||||
if (!rows.length) {
|
||||
document.getElementById('device-ports-title').textContent = 'Front panel';
|
||||
return;
|
||||
}
|
||||
document.getElementById('device-ports-title').textContent =
|
||||
`${title} · ${rows.filter(r => r.up).length} of ${rows.length} up`;
|
||||
document.getElementById('device-table-search').setAttribute('aria-label', `Filter ${title.toLowerCase()}`);
|
||||
document.getElementById('device-error-count').textContent = rows.filter(rowHasProblem).length;
|
||||
}
|
||||
|
||||
function render(d) {
|
||||
_device = d;
|
||||
document.getElementById('device-dot').className = `dot-${d.status || 'unknown'}`;
|
||||
document.getElementById('device-subtitle').textContent =
|
||||
[d.kind, d.ip, d.model].filter(Boolean).join(' · ') +
|
||||
(d.updated ? ` · updated ${new Date(_toIso(d.updated)).toLocaleTimeString()}` : '');
|
||||
|
||||
const unifi = d.source === 'unifi';
|
||||
document.getElementById('device-actions').innerHTML = `
|
||||
<button class="lt-btn lt-btn-ghost lt-btn-sm btn-suppress" data-sup-type="${unifi ? 'unifi_device' : 'host'}"
|
||||
data-sup-name="${esc(d.name)}" data-sup-detail="" aria-label="Suppress alerts for ${esc(d.name)}">🔕 Suppress</button>`;
|
||||
|
||||
document.getElementById('device-root').innerHTML =
|
||||
renderOverview(d) +
|
||||
renderEvents(d.events) +
|
||||
renderWan(d) +
|
||||
renderUplinks(d) +
|
||||
renderOutlets(d);
|
||||
|
||||
const hasPorts = !!(d.ports && Object.keys(d.ports).length);
|
||||
// A device like a UPS has a faceplate worth showing but no ports to list
|
||||
const hasChassis = hasPorts || !!FACEPLATES[d.model];
|
||||
document.getElementById('device-inspector').classList.toggle('has-chassis', hasChassis);
|
||||
updateInterfaceSection(currentRows(), d.ports ? 'Ports' : 'Interfaces', hasChassis);
|
||||
if (hasChassis) renderPortInspector(d);
|
||||
renderInterfaces();
|
||||
|
||||
if (d.kind === 'modem') refreshModem();
|
||||
}
|
||||
|
||||
async function loadDevice() {
|
||||
try {
|
||||
render(await lt.api.get(`/api/device/${encodeURIComponent(DEVICE_NAME)}`));
|
||||
} catch (err) {
|
||||
if (_device) {
|
||||
lt.toast.error('Could not refresh device data');
|
||||
return;
|
||||
}
|
||||
const notFound = /404|No device/.test(err.message || '');
|
||||
document.getElementById('device-root').innerHTML = `
|
||||
<div class="lt-empty-state">
|
||||
<div class="lt-empty-state-icon">✕</div>
|
||||
<div class="lt-empty-state-title">${notFound ? 'No device with this name' : 'Could not load this device'}</div>
|
||||
<div class="lt-empty-state-body">${notFound ? 'It may have been renamed, or the monitor may not have seen it yet.' : 'Check that the Gandalf service is healthy, then refresh.'}</div>
|
||||
</div>`;
|
||||
}
|
||||
}
|
||||
|
||||
document.addEventListener('click', e => {
|
||||
// Switch and router rows open the shared port panel, except when following a link
|
||||
const portRow = e.target.closest('tr.device-row[data-port-idx]');
|
||||
if (portRow && !e.target.closest('a')) {
|
||||
selectPortByIdx(_device.name, parseInt(portRow.dataset.portIdx, 10));
|
||||
return;
|
||||
}
|
||||
const toggle = e.target.closest('.device-row-toggle');
|
||||
if (toggle) {
|
||||
const id = toggle.dataset.row;
|
||||
if (_openRows.has(id)) _openRows.delete(id); else _openRows.add(id);
|
||||
renderInterfaces();
|
||||
return;
|
||||
}
|
||||
const pill = e.target.closest('[data-device-filter]');
|
||||
if (pill) {
|
||||
_filter = pill.dataset.deviceFilter;
|
||||
document.querySelectorAll('[data-device-filter]').forEach(p => {
|
||||
const on = p === pill;
|
||||
p.classList.toggle('active', on);
|
||||
p.setAttribute('aria-pressed', String(on));
|
||||
});
|
||||
renderInterfaces();
|
||||
}
|
||||
});
|
||||
|
||||
document.addEventListener('input', e => {
|
||||
if (e.target.id === 'device-table-search') {
|
||||
_query = e.target.value;
|
||||
renderInterfaces();
|
||||
}
|
||||
});
|
||||
|
||||
loadDevice();
|
||||
const _deviceInterval = window.gandalfSettings?.refreshInterval ?? 60;
|
||||
if (_deviceInterval > 0) lt.autoRefresh.start(loadDevice, Math.max(_deviceInterval, 15) * 1000);
|
||||
|
||||
window.onGandalfSettingsChanged = function (s) {
|
||||
lt.autoRefresh.stop();
|
||||
if (s.refreshInterval > 0) lt.autoRefresh.start(loadDevice, Math.max(s.refreshInterval, 15) * 1000);
|
||||
};
|
||||
@@ -0,0 +1,495 @@
|
||||
'use strict';
|
||||
/* exported renderFaceplate, faceplateScrollLeft, FACEPLATES */
|
||||
|
||||
// Realistic front panels, drawn as SVG from each model's real geometry.
|
||||
// Coordinates are traced from reference images. Keys match UniFi's model code.
|
||||
//
|
||||
// To add a model, add an entry to FACEPLATES:
|
||||
// width, height viewBox size, in proportion to the real device
|
||||
// label name used for screen readers
|
||||
// frameClass how a narrow panel adapts: fp-crop-* (style.css), fp-scroll, fp-desk or fp-fit
|
||||
// noBody decor() draws the whole body itself
|
||||
// scrollX left edge of the port area, shown first in an fp-scroll panel
|
||||
// legend [[LED class, text], ...]
|
||||
// decor(ctx) SVG for the fixed parts, ctx: { online }
|
||||
// ports { idx, type: 'rj45'|'sfp', x, y, ... } for each port
|
||||
// outlets { idx, kind, x, y, w, h, label } for each power outlet
|
||||
// Models without an entry use the plain block layout in port-inspector.js.
|
||||
|
||||
// LED colors come from each model's quick start guide.
|
||||
const FP_LED_RULES = {
|
||||
rj45(mbps) { return mbps >= 1000 ? 'green' : 'amber'; },
|
||||
sfp(mbps) { return mbps >= 10000 ? 'white' : 'green'; },
|
||||
// USW Flex: green at every speed
|
||||
linkOnly() { return 'green'; },
|
||||
};
|
||||
|
||||
function faceplateLed(port, rule) {
|
||||
if (!port || !port.up) return 'off';
|
||||
if (!port.speed_mbps) return 'unknown';
|
||||
return FP_LED_RULES[rule](port.speed_mbps);
|
||||
}
|
||||
|
||||
function ledActivityClass(port) {
|
||||
if (!port || !port.up) return '';
|
||||
return (port.tx_bytes_rate || port.rx_bytes_rate) ? ' fp-led-active' : '';
|
||||
}
|
||||
|
||||
const hasPoe = port => !!(port && port.poe_power > 0);
|
||||
|
||||
// An RJ45 jack seen head-on, centered on (0,0) with the clip notch up.
|
||||
// A cable is drawn in the jack when the port has link.
|
||||
function rj45Svg(port, p) {
|
||||
const led = faceplateLed(port, p.rule || 'rj45');
|
||||
const plug = port && port.up
|
||||
? `<rect class="fp-plug" x="-12" y="-6.5" width="24" height="14" rx="1"/>
|
||||
<rect class="fp-plug-clip" x="-5" y="-14" width="10" height="8"/>`
|
||||
: `<g class="fp-contacts">${[-9, -6, -3, 0, 3, 6, 9].map(x => `<rect x="${x - .6}" y="-8" width="1.2" height="4"/>`).join('')}</g>`;
|
||||
const leftLed = p.poeLed ? `fp-led fp-led-${hasPoe(port) ? 'amber' : 'off'}` : 'fp-led-idle';
|
||||
return `
|
||||
<path class="fp-jack" d="M-15 -8.5 H-7.5 V-16 H7.5 V-8.5 H15 V-3 H16 V1 H15 V9 H-15 V1 H-16 V-3 H-15 Z"/>
|
||||
${plug}
|
||||
<rect class="${leftLed}" x="-16" y="-14" width="7.5" height="3.2" rx=".8"/>
|
||||
<rect class="fp-led fp-led-${led}${ledActivityClass(port)}" x="8.5" y="-14" width="7.5" height="3.2" rx=".8"/>`;
|
||||
}
|
||||
|
||||
// An SFP+ cage seen head-on. Fills with a module when the port has link.
|
||||
function sfpSvg(port, w, h) {
|
||||
const inner = port && port.up
|
||||
? `<rect class="fp-module" x="2.5" y="2.5" width="${w - 5}" height="${h - 5}" rx="1"/>
|
||||
<rect class="fp-module-lc" x="6.5" y="6" width="9" height="${h - 12}" rx="1.2"/>
|
||||
<rect class="fp-module-lc" x="${w - 15.5}" y="6" width="9" height="${h - 12}" rx="1.2"/>`
|
||||
: `<path class="fp-cage-spring" d="M4 5 H${w - 4} M4 ${h - 5} H${w - 4}"/>
|
||||
<rect class="fp-cage-rail" x="${w / 2 - 8}" y="${h / 2 - 2}" width="16" height="4" rx="1"/>`;
|
||||
return `<rect class="fp-cage" width="${w}" height="${h}" rx="1"/>${inner}`;
|
||||
}
|
||||
|
||||
// The cages' LEDs sit between them: left ▲ for the top port, right ▼ for the bottom.
|
||||
function sfpLedSvg(p, port) {
|
||||
const [x, y] = p.led;
|
||||
const points = p.flip ? `${x - 2.4},${y - 1.8} ${x + 2.4},${y - 1.8} ${x},${y + 2}`
|
||||
: `${x - 2.4},${y + 1.8} ${x + 2.4},${y + 1.8} ${x},${y - 2}`;
|
||||
return `<polygon class="fp-led fp-led-${faceplateLed(port, 'sfp')}${ledActivityClass(port)}" points="${points}"/>`;
|
||||
}
|
||||
|
||||
function portLabelSvg(p, port) {
|
||||
if (!p.label) return '';
|
||||
const [x, y] = p.label;
|
||||
const size = p.labelSize ? ` style="font-size:${p.labelSize}px"` : '';
|
||||
const bolt = hasPoe(port) && !p.poeLed
|
||||
? `<path class="fp-bolt" transform="translate(${x + 8} ${y - 8})" d="M3 0 L0 5 H2.2 L1.4 9 L5 3.6 H2.8 L4 0 Z"/>`
|
||||
: '';
|
||||
return `<text class="fp-label" x="${x}" y="${y}" text-anchor="middle"${size}>${p.text || p.idx}</text>${bolt}`;
|
||||
}
|
||||
|
||||
function faceplatePortSvg(p, port, swName, title) {
|
||||
// The drawn port number can differ from the index UniFi reports (see anyPort)
|
||||
const idx = (p.anyPort && port) ? port.port_idx : p.idx;
|
||||
const attrs = `class="fp-port${port && port.up ? ' fp-up' : ''}" data-switch="${lt.escHtml(swName)}" data-port-idx="${idx}"
|
||||
data-action="select-port" role="button" tabindex="0" aria-label="${title}"`;
|
||||
if (p.type === 'sfp') {
|
||||
return `<g ${attrs} transform="translate(${p.x} ${p.y})">
|
||||
<title>${title}</title>
|
||||
${sfpSvg(port, p.w, p.h)}
|
||||
<rect class="fp-hit" x="-1" y="-1" width="${p.w + 2}" height="${p.h + 2}" rx="2"/>
|
||||
</g>
|
||||
${sfpLedSvg(p, port)}${portLabelSvg(p, port)}`;
|
||||
}
|
||||
const scale = p.scale || 1;
|
||||
return `<g ${attrs} transform="translate(${p.x} ${p.y}) scale(${scale})">
|
||||
<title>${title}</title>
|
||||
<g transform="scale(1 ${p.flip ? -1 : 1})">${rj45Svg(port, p)}</g>
|
||||
<rect class="fp-hit" x="-18" y="-${p.flip ? 11 : 17}" width="36" height="28" rx="2"/>
|
||||
</g>${portLabelSvg(p, port)}`;
|
||||
}
|
||||
|
||||
// ── Power outlets ────────────────────────────────────────────────────────
|
||||
function outletFaceSvg(kind, w, h, idx) {
|
||||
const cx = w / 2, cy = h / 2;
|
||||
if (kind === 'tile') {
|
||||
return `<rect class="fp-tile" width="${w}" height="${h}" rx="2"/>
|
||||
<text class="fp-tile-num" x="${cx}" y="${cy + 3.5}" text-anchor="middle">${idx}</text>`;
|
||||
}
|
||||
if (kind === 'usbc') {
|
||||
return `<rect class="fp-usbc" width="${w}" height="${h}" rx="${w / 2}"/>
|
||||
<rect class="fp-usbc-tongue" x="${cx - 1}" y="4" width="2" height="${h - 8}" rx="1"/>`;
|
||||
}
|
||||
const face = `<rect class="fp-outlet-face" width="${w}" height="${h}" rx="3"/>`;
|
||||
if (kind === 'horizontal') {
|
||||
return `${face}
|
||||
<rect class="fp-slot" x="${cx - 24}" y="${cy - 15}" width="19" height="4.5" rx=".6"/>
|
||||
<rect class="fp-slot" x="${cx - 24}" y="${cy + 10.5}" width="19" height="4.5" rx=".6"/>
|
||||
<path class="fp-slot" d="M${cx + 12} ${cy - 8} h13 v16 h-13 a8 8 0 0 1 0 -16 Z"/>`;
|
||||
}
|
||||
const tee = kind === 'vertical-20'
|
||||
? `<rect class="fp-slot" x="${cx + 12}" y="${cy - 8}" width="10" height="4"/>` : '';
|
||||
return `${face}
|
||||
<rect class="fp-slot" x="${cx - 19}" y="${cy - 23}" width="5" height="19" rx=".6"/>
|
||||
<rect class="fp-slot" x="${cx + 14}" y="${cy - 23}" width="5" height="19" rx=".6"/>
|
||||
${tee}
|
||||
<path class="fp-slot" d="M${cx - 7.5} ${cy + 22} v-9 a7.5 7.5 0 0 1 15 0 v9 Z"/>`;
|
||||
}
|
||||
|
||||
function outletTitle(o, data) {
|
||||
const parts = [`Outlet ${o.idx}`];
|
||||
if (data) {
|
||||
if (data.name && data.name !== parts[0]) parts.push(data.name);
|
||||
parts.push(data.on === false ? 'off' : 'on');
|
||||
if (data.power_w != null) parts.push(`${data.power_w.toFixed(1)} W`);
|
||||
if (data.auto_power_cycle) parts.push('auto power-cycle');
|
||||
}
|
||||
return lt.escHtml(parts.join(' · '));
|
||||
}
|
||||
|
||||
function faceplateOutletSvg(o, data) {
|
||||
const title = outletTitle(o, data);
|
||||
const off = data && data.on === false;
|
||||
const face = outletFaceSvg(o.kind, o.w, o.h, o.idx);
|
||||
const group = `<g class="fp-outlet${off ? ' fp-outlet-is-off' : ''}" tabindex="0" role="img" aria-label="${title}" transform="translate(${o.x} ${o.y})">
|
||||
<title>${title}</title>
|
||||
${o.flip ? `<g transform="rotate(180 ${o.w / 2} ${o.h / 2})">${face}</g>` : face}
|
||||
<rect class="fp-hit" x="-1.5" y="-1.5" width="${o.w + 3}" height="${o.h + 3}" rx="3"/>
|
||||
</g>`;
|
||||
if (!o.label) return group;
|
||||
const [lx, ly] = o.label;
|
||||
// An outlet can read 0 W while its device runs, so only the relay state means off
|
||||
const state = `<circle class="fp-outlet-state ${off ? 'fp-state-off' : data ? 'fp-state-on' : ''}" cx="${lx - 9}" cy="${ly - 3}" r="2.2"/>`;
|
||||
const cycle = data && data.auto_power_cycle
|
||||
? `<path class="fp-cycle" transform="translate(${lx + 8} ${ly - 7})" d="M7 1.5 A3.5 3.5 0 1 0 8 5 M7 0 V2.5 H4.5"/>` : '';
|
||||
return `${group}${state}<text class="fp-label" x="${lx}" y="${ly}" text-anchor="middle">${o.idx}</text>${cycle}`;
|
||||
}
|
||||
|
||||
// A jack Gandalf gets no data for. Hovering or focusing it says what it is.
|
||||
function fpPassiveJack(x, y, flip, description) {
|
||||
const title = lt.escHtml(description);
|
||||
return `<g class="fp-outlet fp-static" tabindex="0" role="img" aria-label="${title}" transform="translate(${x} ${y})">
|
||||
<title>${title}</title>
|
||||
<g transform="scale(1 ${flip ? -1 : 1})">${rj45Svg(null, {})}</g>
|
||||
<rect class="fp-hit" x="-18" y="-${flip ? 11 : 17}" width="36" height="28" rx="2"/>
|
||||
</g>`;
|
||||
}
|
||||
|
||||
// ── Shared drawing helpers ───────────────────────────────────────────────
|
||||
const fpGlobe = (x, y) => `<g class="fp-globe" transform="translate(${x} ${y})">
|
||||
<circle r="3.4"/><ellipse rx="1.5" ry="3.4"/><path d="M-3.4 0 H3.4"/></g>`;
|
||||
|
||||
const fpVents = (spans, y, h = 2.6) => spans
|
||||
.map(([a, b]) => `<rect class="fp-vent" x="${a}" y="${y}" width="${b - a}" height="${h}" rx="${h / 2}"/>`).join('');
|
||||
|
||||
const fpReset = (x, y) => `<circle class="fp-reset" cx="${x}" cy="${y}" r="2.2"/>
|
||||
<text class="fp-label fp-label-sm" x="${x + 5}" y="${y + 2.5}">RESET</text>`;
|
||||
|
||||
// The status screen on UniFi switches: four quadrants around a center dot
|
||||
function fpQuadScreen(x, y, s) {
|
||||
const c = s / 2;
|
||||
const icons = [[.24, .24], [.76, .24], [.24, .76], [.76, .76]]
|
||||
.map(([a, b]) => `<circle class="fp-screen-icon" cx="${s * a}" cy="${s * b}" r="${s * .07}"/>`).join('');
|
||||
return `<g transform="translate(${x} ${y})">
|
||||
<rect class="fp-screen" width="${s}" height="${s}" rx="3"/>
|
||||
<path class="fp-screen-grid" d="M${c} 3 V${s - 3} M3 ${c} H${s - 3}"/>
|
||||
${icons}
|
||||
<circle class="fp-screen-dot" cx="${c}" cy="${c}" r="${s * .11}"/>
|
||||
</g>`;
|
||||
}
|
||||
|
||||
const fpBrand = (x, y, text) => `<text class="fp-brand" x="${x}" y="${y}">${text}</text>`;
|
||||
|
||||
// Two rows of jacks, odd numbers on top: how UniFi rack switches number ports
|
||||
function rj45Pairs(columns, rows) {
|
||||
return columns.flatMap((x, i) => [
|
||||
{ idx: 2 * i + 1, type: 'rj45', x, y: rows.top, label: [x, rows.topLabel] },
|
||||
{ idx: 2 * i + 2, type: 'rj45', x, y: rows.bottom, flip: true, label: [x, rows.bottomLabel] },
|
||||
]);
|
||||
}
|
||||
|
||||
function sfpPairs(columns, g) {
|
||||
return columns.flatMap((x, i) => [
|
||||
{ idx: g.first + 2 * i, type: 'sfp', x, y: g.top, w: g.w, h: g.h,
|
||||
led: [x + g.w / 2 - g.ledGap, g.ledY], label: g.topLabel && [x + g.w / 2, g.topLabel] },
|
||||
{ idx: g.first + 2 * i + 1, type: 'sfp', x, y: g.bottom, w: g.w, h: g.h, flip: true,
|
||||
led: [x + g.w / 2 + g.ledGap, g.ledY], label: g.bottomLabel && [x + g.w / 2, g.bottomLabel] },
|
||||
]);
|
||||
}
|
||||
|
||||
const roleRange = (from, to, role) => Object.fromEntries(
|
||||
Array.from({ length: to - from + 1 }, (_, i) => [from + i, role]));
|
||||
|
||||
const LEGEND_RJ45 = [['off', 'no link'], ['amber', '10/100M'], ['green', '1G']];
|
||||
|
||||
const FACEPLATES = {
|
||||
// https://dl.ui.com/qsg/UDM-Pro/UDM-Pro_EN.html
|
||||
UDMPRO: {
|
||||
width: 1065, height: 106, frameClass: 'fp-crop-udmpro',
|
||||
label: 'Dream Machine Pro',
|
||||
legend: [...LEGEND_RJ45, ['white', '10G']],
|
||||
roles: {
|
||||
...roleRange(1, 8, 'RJ45 LAN'),
|
||||
9: 'RJ45 Internet', 10: 'SFP+ Internet', 11: 'SFP+ LAN',
|
||||
},
|
||||
ports: [
|
||||
...rj45Pairs([760.5, 798, 835.5, 873], { top: 40, bottom: 66, topLabel: 18.5, bottomLabel: 93.5 }),
|
||||
{ idx: 9, type: 'rj45', x: 948, y: 69 },
|
||||
{ idx: 10, type: 'sfp', x: 975, y: 22, w: 35, h: 23.5, led: [985, 52.5] },
|
||||
{ idx: 11, type: 'sfp', x: 975, y: 59.5, w: 35, h: 23.5, flip: true, led: [1000, 52.5] },
|
||||
],
|
||||
decor() {
|
||||
return `${fpVents([[90, 268], [277, 452], [462, 638], [647, 822], [833, 1010]], 8)}
|
||||
<rect class="fp-screen" x="15" y="25" width="56" height="56" rx="3"/>
|
||||
<circle class="fp-screen-ring" cx="43" cy="51" r="13"/>
|
||||
<circle class="fp-screen-dot" cx="43" cy="51" r="4.5"/>
|
||||
${fpBrand(16, 94, 'Dream Machine Pro')}
|
||||
<rect class="fp-bay" x="447" y="19" width="259" height="66" rx="1.5"/>
|
||||
<rect class="fp-bay-edge" x="447.8" y="19.8" width="3.5" height="64.4"/>
|
||||
<circle class="fp-bay-led" cx="681" cy="52" r="1.6"/>
|
||||
<rect class="fp-block" x="740" y="22" width="153" height="61.5" rx="1"/>
|
||||
<rect class="fp-block" x="928" y="50" width="40" height="33.5" rx="1"/>
|
||||
<rect class="fp-divider" x="975" y="45.5" width="35" height="14"/>
|
||||
<text class="fp-label" x="941" y="93.5" text-anchor="middle">9</text>${fpGlobe(951, 90.5)}
|
||||
<text class="fp-label" x="987" y="18.5" text-anchor="middle">10</text>${fpGlobe(999, 15.5)}
|
||||
<text class="fp-label" x="992.5" y="93.5" text-anchor="middle">11</text>
|
||||
${fpReset(1026, 91)}`;
|
||||
},
|
||||
},
|
||||
|
||||
// Port layout and LED colors: https://dl.ui.com/qsg/USW-Pro-24/USW-Pro-24_EN.html
|
||||
// (the non-PoE sibling). PoE draw has no documented LED, so it is a bolt by the number.
|
||||
US24PRO: {
|
||||
width: 1179, height: 113, frameClass: 'fp-scroll', scrollX: 550,
|
||||
label: 'USW Pro 24 PoE',
|
||||
legend: [...LEGEND_RJ45, ['white', '10G'], ['poe', 'PoE in use']],
|
||||
roles: { ...roleRange(1, 24, 'RJ45'), 25: 'SFP+', 26: 'SFP+' },
|
||||
ports: [
|
||||
...rj45Pairs([586.7, 624.2, 661.7, 699.2, 736.7, 774.2, 820, 857.5, 895, 932.5, 970, 1007.5],
|
||||
{ top: 38, bottom: 69, topLabel: 15.5, bottomLabel: 98 }),
|
||||
...sfpPairs([1083], { first: 25, top: 19, bottom: 61, w: 39, h: 26, ledY: 53.5, ledGap: 10.5,
|
||||
topLabel: 15.5, bottomLabel: 98 }),
|
||||
],
|
||||
decor() {
|
||||
return `${fpVents([[98, 298], [304, 504], [512, 710], [717, 917], [923, 1122]], 3)}
|
||||
${fpQuadScreen(15, 23, 62)}${fpBrand(17, 99, 'USW Pro')}
|
||||
<rect class="fp-block" x="563" y="19" width="234" height="69" rx="1"/>
|
||||
<rect class="fp-block" x="797.5" y="19" width="233" height="69" rx="1"/>
|
||||
<rect class="fp-divider" x="1083" y="45" width="39" height="16"/>
|
||||
${fpReset(1140, 97)}`;
|
||||
},
|
||||
},
|
||||
|
||||
// No quick start guide was available: layout from a reference image. LED colors
|
||||
// are taken from the SFP+ ports of the USW Pro 24 guide.
|
||||
USL8A: {
|
||||
width: 1115, height: 110, frameClass: 'fp-crop-agg',
|
||||
label: 'USW Aggregation',
|
||||
legend: [['off', 'no link'], ['green', '1G'], ['white', '10G']],
|
||||
roles: roleRange(1, 8, 'SFP+'),
|
||||
ports: sfpPairs([876.4, 925.6, 975.6, 1025], {
|
||||
first: 1, top: 21.6, bottom: 61.6, w: 36, h: 25, ledY: 54.5, ledGap: 9.5, topLabel: 17, bottomLabel: 95,
|
||||
}),
|
||||
decor() {
|
||||
const dividers = [876.4, 925.6, 975.6, 1025]
|
||||
.map(x => `<rect class="fp-divider" x="${x}" y="46.6" width="36" height="15"/>`).join('');
|
||||
return `${fpVents([[91, 280], [287, 476], [482, 671], [678, 867], [874, 1062]], 7)}
|
||||
${fpQuadScreen(12, 25, 58)}${fpBrand(28, 96, 'USW')}
|
||||
${dividers}
|
||||
<rect class="fp-speed-bar" x="874" y="99" width="188" height="4" rx="1"/>
|
||||
${fpReset(1078.6, 95)}`;
|
||||
},
|
||||
},
|
||||
|
||||
// https://dl.ui.com/qsg/USW-Flex/USW-Flex_EN.html
|
||||
USF5P: {
|
||||
width: 553, height: 128, frameClass: 'fp-desk', noBody: true,
|
||||
label: 'USW Flex',
|
||||
legend: [['off', 'no link'], ['green', 'link'], ['amber', 'PoE out']],
|
||||
roles: { 1: 'RJ45, PoE in', ...roleRange(2, 5, 'RJ45, PoE out') },
|
||||
ports: [170, 225, 280, 335, 391].map((x, i) => ({
|
||||
idx: i + 1, type: 'rj45', x, y: 60, scale: 1.6, rule: 'linkOnly', poeLed: i > 0,
|
||||
label: [x, 106], labelSize: 12,
|
||||
})),
|
||||
decor() {
|
||||
return `<rect class="fp-body-white" x="66" y="6" width="422" height="110" rx="18"/>
|
||||
<rect class="fp-frame-grey" x="130" y="26" width="291" height="66" rx="3"/>
|
||||
<rect class="fp-foot" x="115" y="116" width="44" height="6" rx="2"/>
|
||||
<rect class="fp-foot" x="395" y="116" width="44" height="6" rx="2"/>`;
|
||||
},
|
||||
},
|
||||
|
||||
// https://dl.ui.com/qsg/USW-Flex-Mini/USW-Flex-Mini_EN.html
|
||||
USMINI: {
|
||||
width: 663, height: 160, frameClass: 'fp-desk', noBody: true,
|
||||
label: 'USW Flex Mini',
|
||||
legend: LEGEND_RJ45,
|
||||
roles: { 1: 'RJ45, PoE in', ...roleRange(2, 5, 'RJ45') },
|
||||
ports: [132, 235, 332, 430, 527].map((x, i) => ({
|
||||
idx: i + 1, type: 'rj45', x, y: 73, scale: 2.4,
|
||||
label: [x, 134], labelSize: 14, text: i === 0 ? 'PoE IN' : String(i + 1),
|
||||
})),
|
||||
decor() {
|
||||
return `<rect class="fp-body-white" x="2" y="14" width="659" height="134" rx="26"/>
|
||||
<rect class="fp-frame-grey" x="82" y="28" width="98" height="84" rx="2"/>
|
||||
<rect class="fp-frame-grey" x="184" y="28" width="392" height="84" rx="2"/>
|
||||
<circle class="fp-reset" cx="62" cy="68" r="3"/>
|
||||
<text class="fp-label fp-label-sm" x="590" y="52">LINK</text>
|
||||
<rect class="fp-key" x="590" y="59" width="6" height="6"/><text class="fp-label fp-label-sm" x="600" y="65">DOWN</text>
|
||||
<rect class="fp-key fp-key-amber" x="590" y="71" width="6" height="6"/><text class="fp-label fp-label-sm" x="600" y="77">10/100</text>
|
||||
<rect class="fp-key fp-key-green" x="590" y="83" width="6" height="6"/><text class="fp-label fp-label-sm" x="600" y="89">1000</text>`;
|
||||
},
|
||||
},
|
||||
|
||||
// Layout from a reference image, no quick start guide was available. Outlets 1-4 are
|
||||
// USB-C, 5-16 AC, 17-20 larger AC. Port 21 is management, the one port UniFi reports.
|
||||
// Ports 22 and 23 are a surge pass-through pair (for a modem line) with no data.
|
||||
USPPDUP: {
|
||||
width: 1174, height: 215, frameClass: 'fp-scroll', noBody: true,
|
||||
label: 'USP PDU Pro',
|
||||
legend: [['outlet-on', 'outlet on'], ['outlet-off', 'outlet off'], ['cycle', 'auto power-cycle']],
|
||||
roles: { 21: 'RJ45 management' },
|
||||
ports: [
|
||||
{ idx: 21, anyPort: true, type: 'rj45', x: 996.5, y: 178, label: [996.5, 200] },
|
||||
],
|
||||
outlets: [
|
||||
...[[1, 74, 22, [68, 36]], [2, 74, 62, [68, 76]], [3, 109, 22, [102, 36]], [4, 109, 62, [102, 76]]]
|
||||
.map(([idx, x, y, label]) => ({ idx, kind: 'usbc', x, y, w: 9, h: 24, label })),
|
||||
...Array.from({ length: 12 }, (_, i) => {
|
||||
const x = 175 + i * 66.75;
|
||||
return { idx: 5 + i, kind: 'horizontal', x, y: 21, w: 66, h: 64, label: [x + 33, 96] };
|
||||
}),
|
||||
...[208, 431, 654, 877].map((x, i) => ({
|
||||
idx: 17 + i, kind: i === 3 ? 'vertical-20' : 'vertical', x, y: 126, w: 66, h: 67, label: [x + 33, 205],
|
||||
})),
|
||||
],
|
||||
decor() {
|
||||
const ear = x => `<rect class="fp-ear" x="${x}" y="2" width="48" height="211" rx="5"/>
|
||||
<rect class="fp-ear-hole" x="${x + 13}" y="7" width="27" height="17" rx="8.5"/>
|
||||
<rect class="fp-ear-hole" x="${x + 13}" y="189" width="27" height="17" rx="8.5"/>`;
|
||||
return `${ear(0)}${ear(1126)}
|
||||
<rect class="fp-body-metal" x="48" y="1" width="1078" height="213" rx="1"/>
|
||||
${fpQuadScreen(61, 132, 56)}${fpBrand(68, 199, 'USP PDU Pro')}
|
||||
<circle class="fp-button" cx="1053" cy="53" r="4.5"/>
|
||||
<rect class="fp-block" x="977" y="160" width="39" height="32.5" rx="1"/>
|
||||
<rect class="fp-block" x="1032" y="130" width="41" height="62.5" rx="1"/>
|
||||
${fpPassiveJack(1052.5, 147, false, 'Port 22 · surge pass-through · not monitored')}
|
||||
${fpPassiveJack(1052.5, 175.5, true, 'Port 23 · surge pass-through · not monitored')}
|
||||
<text class="fp-label" x="1049" y="127" text-anchor="middle">22</text>${fpGlobe(1059, 124)}
|
||||
<text class="fp-label" x="1049" y="205" text-anchor="middle">23</text>${fpGlobe(1059, 202)}
|
||||
${fpReset(1088, 201)}`;
|
||||
},
|
||||
},
|
||||
|
||||
// Front and rear from the labeled diagrams on Ubiquiti's store page:
|
||||
// https://store.ui.com/us/en/products/ups-2u-pro
|
||||
// The outlets are on the rear, and the touchscreen shows a tile for each one.
|
||||
USPDA2B: {
|
||||
width: 1086, height: 460, frameClass: 'fp-scroll fp-stack', scrollX: 340, noBody: true,
|
||||
label: 'UPS 2U Pro',
|
||||
legend: [['outlet-on', 'outlet on'], ['outlet-off', 'outlet off'], ['blue', 'online']],
|
||||
ports: [],
|
||||
outlets: [
|
||||
...[457, 478, 498, 535].flatMap((x, i) => [
|
||||
{ idx: i + 1, kind: 'tile', x, y: 83, w: 18, h: 18 },
|
||||
{ idx: i + 5, kind: 'tile', x, y: 104, w: 18, h: 18 },
|
||||
]),
|
||||
...[173, 251, 330, 479].flatMap((x, i) => [
|
||||
{ idx: i + 1, kind: 'vertical-20', flip: true, x, y: 270, w: 66, h: 66, label: [x + 33, 350] },
|
||||
{ idx: i + 5, kind: 'vertical-20', x, y: 373, w: 66, h: 66, label: [x + 33, 453] },
|
||||
]),
|
||||
],
|
||||
decor({ online }) {
|
||||
const spans = [[52, 238], [251, 437], [449, 636], [647, 834], [846, 1032]];
|
||||
const vents = y => spans.flatMap(([a, b]) => [
|
||||
`<rect class="fp-ups-vent" x="${a}" y="${y}" width="${b - a}" height="12" rx="5"/>`,
|
||||
`<path class="fp-ups-rib" d="M${a + (b - a) / 3} ${y} v12 M${a + 2 * (b - a) / 3} ${y} v12"/>`,
|
||||
]).join('');
|
||||
return `<rect class="fp-body-metal" width="1086" height="210" rx="3"/>
|
||||
<rect class="fp-ups-band-light" x="28" y="4" width="1030" height="24" rx="10"/>${vents(10)}
|
||||
<rect class="fp-ups-band" x="28" y="183" width="1030" height="24" rx="10"/>${vents(188)}
|
||||
<circle class="fp-power-ring ${online ? 'fp-power-on' : ''}" cx="51" cy="105" r="19"/>
|
||||
<circle class="fp-power-face" cx="51" cy="105" r="15"/>
|
||||
<path class="fp-power-icon" d="M46.5 100.5 a6.5 6.5 0 1 0 9 0 M51 97 v8"/>
|
||||
<rect class="fp-ups-batt" x="80" y="100" width="15" height="10" rx="2.5"/>
|
||||
<rect class="fp-ups-batt-tip" x="95.5" y="103" width="1.5" height="4"/>
|
||||
<text class="fp-label" x="100" y="109">UPS Pro</text>
|
||||
<rect class="fp-screen" x="430" y="77" width="224" height="55" rx="3"/>
|
||||
<rect class="fp-screen-tile-dim" x="586" y="83" width="16" height="14" rx="2"/>
|
||||
<rect class="fp-screen-tile-dim" x="606" y="83" width="16" height="14" rx="2"/>
|
||||
<rect class="fp-screen-tile-dim" x="596" y="104" width="16" height="14" rx="2"/>
|
||||
<circle class="fp-screen-icon" cx="643" cy="105" r="3.5"/>
|
||||
<text class="fp-caption" x="0" y="238">REAR</text>
|
||||
<g transform="translate(0 248)">
|
||||
<rect class="fp-body-metal" width="1086" height="210" rx="3"/>
|
||||
<circle class="fp-button" cx="68" cy="53" r="22"/><circle class="fp-breaker" cx="68" cy="53" r="11"/>
|
||||
<text class="fp-label fp-label-sm" x="68" y="87" text-anchor="middle">BREAKER</text>
|
||||
<circle class="fp-button" cx="68" cy="155" r="25"/><circle class="fp-breaker" cx="68" cy="155" r="13"/>
|
||||
<text class="fp-label fp-label-sm" x="68" y="192" text-anchor="middle">POWER INPUT</text>
|
||||
<path class="fp-fan" d="M721 20 a83 83 0 1 0 0.01 0 Z M721 52 a51 51 0 1 0 0.01 0 Z"/>
|
||||
<path class="fp-fan-strut" d="M721 20 v32 M638 103 h32 M804 103 h-32 M721 186 v-32"/>
|
||||
<rect class="fp-epo" x="893" y="80" width="15" height="45" rx="1"/>
|
||||
<text class="fp-label fp-label-sm" x="900.5" y="74" text-anchor="middle">EPO</text>
|
||||
<path class="fp-bracket" d="M955 88 v-8 h96 v8"/>
|
||||
<text class="fp-label fp-label-sm" x="1003" y="74" text-anchor="middle">SURGE NETWORK</text>
|
||||
<text class="fp-label fp-label-sm" x="973" y="134" text-anchor="middle">IN</text>
|
||||
<text class="fp-label fp-label-sm" x="1033" y="134" text-anchor="middle">OUT</text>
|
||||
${fpPassiveJack(973, 110, false, 'Surge in · not monitored')}
|
||||
${fpPassiveJack(1033, 110, false, 'Surge out · not monitored')}
|
||||
<rect class="fp-block" x="953" y="145" width="40" height="34" rx="1"/>
|
||||
${fpPassiveJack(973, 165, false, 'MGMT · 100/10 MbE · not monitored per port')}
|
||||
<text class="fp-label fp-label-sm" x="973" y="192" text-anchor="middle">MGMT</text>
|
||||
</g>`;
|
||||
},
|
||||
},
|
||||
};
|
||||
|
||||
function faceplateLegendSwatch(cls) {
|
||||
if (cls === 'poe') return '<svg class="fp-legend-icon" viewBox="0 0 6 10"><path class="fp-bolt" d="M3 0 L0 5 H2.2 L1.4 9 L5 3.6 H2.8 L4 0 Z"/></svg>';
|
||||
if (cls === 'cycle') return '<svg class="fp-legend-icon" viewBox="0 0 10 10"><path class="fp-cycle" d="M7 1.5 A3.5 3.5 0 1 0 8 5 M7 0 V2.5 H4.5"/></svg>';
|
||||
return `<span class="fp-legend-led fp-led-${cls}"></span>`;
|
||||
}
|
||||
|
||||
function faceplateLegendHtml(spec) {
|
||||
const items = spec.legend.map(([cls, text]) =>
|
||||
`<div class="chassis-legend-item">${faceplateLegendSwatch(cls)}${text}</div>`).join('');
|
||||
const hasDetail = spec.ports.length || spec.outlets;
|
||||
return `<div class="chassis-legend">
|
||||
${items}
|
||||
${hasDetail ? '<div class="chassis-legend-item fp-readout" id="fp-readout" aria-live="polite"></div>' : ''}
|
||||
</div>`;
|
||||
}
|
||||
|
||||
// ctx: { swName, portMap, outlets, online, titleFor(port, idx, role) }
|
||||
function renderFaceplate(model, ctx) {
|
||||
const spec = FACEPLATES[model];
|
||||
const anyPort = Object.values(ctx.portMap)[0];
|
||||
const ports = spec.ports.map(p => {
|
||||
const port = ctx.portMap[p.idx] || (p.anyPort ? anyPort : undefined);
|
||||
const title = ctx.titleFor(port, p.idx, spec.roles && spec.roles[p.idx]);
|
||||
return faceplatePortSvg(p, port, ctx.swName, title);
|
||||
}).join('');
|
||||
const outletData = Object.fromEntries((ctx.outlets || []).map(o => [o.index, o]));
|
||||
const outlets = (spec.outlets || []).map(o => faceplateOutletSvg(o, outletData[o.idx])).join('');
|
||||
const body = spec.noBody ? ''
|
||||
: `<rect class="fp-body" width="${spec.width}" height="${spec.height}" rx="3"/>`;
|
||||
return `<div class="fp-wrap">
|
||||
<div class="fp-frame ${spec.frameClass}">
|
||||
<svg class="fp-svg" viewBox="0 0 ${spec.width} ${spec.height}" role="group" aria-label="${lt.escHtml(spec.label)} front panel">
|
||||
<defs>
|
||||
<linearGradient id="fp-metal" x1="0" y1="0" x2="0" y2="1">
|
||||
<stop offset="0" stop-color="#e4e4e6"/><stop offset=".08" stop-color="#d6d6d8"/>
|
||||
<stop offset=".92" stop-color="#cfcfd2"/><stop offset="1" stop-color="#a9a9ad"/>
|
||||
</linearGradient>
|
||||
<linearGradient id="fp-bay-face" x1="0" y1="0" x2="0" y2="1">
|
||||
<stop offset="0" stop-color="#d9d9db"/><stop offset="1" stop-color="#cdcdd0"/>
|
||||
</linearGradient>
|
||||
</defs>
|
||||
${body}
|
||||
${spec.decor({ online: ctx.online })}
|
||||
${outlets}
|
||||
${ports}
|
||||
</svg>
|
||||
</div>
|
||||
</div>${faceplateLegendHtml(spec)}`;
|
||||
}
|
||||
|
||||
// Where an fp-scroll panel should start: its port area
|
||||
function faceplateScrollLeft(model, frame) {
|
||||
const spec = FACEPLATES[model];
|
||||
return spec.scrollX ? (frame.scrollWidth / spec.width) * spec.scrollX : 0;
|
||||
}
|
||||
@@ -1,54 +1,14 @@
|
||||
{% extends "base.html" %}
|
||||
{% block title %}Inspector – GANDALF{% endblock %}
|
||||
'use strict';
|
||||
/* global deviceUrl, FACEPLATES, renderFaceplate, faceplateScrollLeft */
|
||||
/* exported renderPortInspector, fmtRate, fmtErrors */
|
||||
|
||||
{% block content %}
|
||||
// Port inspector for a switch or router's device page: front-panel diagram,
|
||||
// port detail panel, switch/server path check, and link diagnostics.
|
||||
|
||||
<div class="lt-page-header">
|
||||
<div>
|
||||
<h1 class="lt-page-title">Network Inspector</h1>
|
||||
<p class="g-page-sub">
|
||||
Visual switch chassis diagrams. Click a port to see detailed stats and LLDP path debug.
|
||||
<span id="inspector-updated" class="g-page-sub-aside"></span>
|
||||
</p>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div class="inspector-layout">
|
||||
<div class="inspector-main" id="inspector-main" role="region" aria-label="Switch chassis diagrams">
|
||||
<div class="link-loading">Loading inspector data</div>
|
||||
</div>
|
||||
<div class="inspector-panel" id="inspector-panel" role="complementary" aria-label="Port detail panel">
|
||||
<div class="inspector-panel-inner" id="inspector-panel-inner"></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{% endblock %}
|
||||
|
||||
{% block scripts %}
|
||||
<script>
|
||||
const escHtml = s => lt.escHtml(s);
|
||||
|
||||
// ── Switch layout config ─────────────────────────────────────────────────
|
||||
// keys match the model field returned by the UniFi API
|
||||
// rows: array of rows, each row is an array of port_idx values
|
||||
// sfp_ports: port_idx values that are SFP cages (in rows, rendered differently)
|
||||
// sfp_section: port_idx values rendered as a separate SFP bank below the rows
|
||||
const SWITCH_LAYOUTS = {
|
||||
'USF5P': { rows: [[1,2,3,4]], sfp_section: [5] },
|
||||
'USL8A': { rows: [[1,2,3,4],[5,6,7,8]], sfp_ports: [1,2,3,4,5,6,7,8] },
|
||||
'US24PRO': {
|
||||
rows: [
|
||||
[1,3,5,7,9,11,13,15,17,19,21,23],
|
||||
[2,4,6,8,10,12,14,16,18,20,22,24],
|
||||
],
|
||||
sfp_section: [25,26],
|
||||
},
|
||||
'USPPDUP': { rows: [[1]] },
|
||||
'USMINI': { rows: [[1,2,3,4,5]] },
|
||||
};
|
||||
|
||||
// ── Formatting helpers ───────────────────────────────────────────────────
|
||||
function fmtSpeed(mbps) {
|
||||
function fmtShortSpeed(mbps) {
|
||||
if (!mbps) return '–';
|
||||
if (mbps >= 1000) return (mbps / 1000).toFixed(0) + 'G';
|
||||
return mbps + 'M';
|
||||
@@ -91,7 +51,7 @@ function portBlockState(d) {
|
||||
// ── Speed label helper ───────────────────────────────────────────────────
|
||||
function portSpeedLabel(port) {
|
||||
if (!port || !port.up) return '';
|
||||
const spd = port.speed; // speed in Mbps from UniFi API
|
||||
const spd = port.speed_mbps;
|
||||
if (!spd) return '';
|
||||
if (spd >= 10000) return '10G';
|
||||
if (spd >= 1000) return '1G';
|
||||
@@ -99,11 +59,42 @@ function portSpeedLabel(port) {
|
||||
return spd + 'M';
|
||||
}
|
||||
|
||||
// Blocks only fit a few characters of the neighbor, so hover text carries it in full
|
||||
function portTitle(port, idx) {
|
||||
if (!port) return `Port ${idx}`;
|
||||
const neighbor = port.lldp && (port.lldp.system_name || port.lldp.chassis_id);
|
||||
return escHtml(neighbor ? `${port.name} → ${neighbor}` : port.name);
|
||||
}
|
||||
|
||||
function faceplatePortTitle(port, idx, role) {
|
||||
const parts = [role ? `Port ${idx} (${role})` : `Port ${idx}`];
|
||||
if (!port || !port.up) {
|
||||
parts.push('no link');
|
||||
} else {
|
||||
const speed = portSpeedLabel(port);
|
||||
if (speed) parts.push(speed);
|
||||
if (port.poe_power > 0) parts.push(`${port.poe_power.toFixed(1)} W PoE`);
|
||||
}
|
||||
const neighbor = port && port.lldp && (port.lldp.system_name || port.lldp.chassis_id);
|
||||
if (neighbor) parts.push(`→ ${neighbor}`);
|
||||
return escHtml(parts.join(' · '));
|
||||
}
|
||||
|
||||
// Faceplate jacks are too small for text, so one line under the panel names
|
||||
// the hovered or selected port.
|
||||
function updateFaceplateReadout(el) {
|
||||
const readout = document.getElementById('fp-readout');
|
||||
if (!readout) return;
|
||||
const target = el || document.querySelector('.fp-port.selected');
|
||||
const title = target && target.getAttribute('aria-label');
|
||||
readout.textContent = title || (document.querySelector('.fp-outlet') ? 'Hover or select an outlet or port' : 'Hover or select a port');
|
||||
}
|
||||
|
||||
// ── Render a single port block element ──────────────────────────────────
|
||||
function portBlockHtml(idx, port, swName, sfpBlock) {
|
||||
const state = portBlockState(port);
|
||||
const numLabel = sfpBlock ? 'SFP' : idx;
|
||||
const title = port ? escHtml(port.name) : `Port ${idx}`;
|
||||
const title = portTitle(port, idx);
|
||||
const sfpCls = sfpBlock ? ' sfp-block' : '';
|
||||
const speedTxt = portSpeedLabel(port);
|
||||
// LLDP neighbor: first 6 chars of hostname
|
||||
@@ -115,7 +106,7 @@ function portBlockHtml(idx, port, swName, sfpBlock) {
|
||||
return `<div class="switch-port-block ${state}${sfpCls}"
|
||||
data-switch="${escHtml(swName)}" data-port-idx="${idx}"
|
||||
title="${title}" aria-label="${title}"
|
||||
data-action="select-port"><span class="port-num">${numLabel}</span>${speedHtml}${lldpHtml}</div>`;
|
||||
data-action="select-port" role="button" tabindex="0"><span class="port-num">${numLabel}</span>${speedHtml}${lldpHtml}</div>`;
|
||||
}
|
||||
|
||||
// ── Chassis legend HTML ──────────────────────────────────────────────────
|
||||
@@ -131,79 +122,36 @@ function chassisLegendHtml() {
|
||||
// ── Render one switch chassis ────────────────────────────────────────────
|
||||
function renderChassis(swName, sw) {
|
||||
const model = sw.model || '';
|
||||
const layout = SWITCH_LAYOUTS[model] || null;
|
||||
const portMap = buildPortIdxMap(sw.ports || {});
|
||||
const ports = Object.entries(sw.ports || {});
|
||||
|
||||
const upCount = Object.values(sw.ports || {}).filter(p => p.up).length;
|
||||
const totCount = Object.keys(sw.ports || {}).length;
|
||||
const downCount = totCount - upCount;
|
||||
const meta = [model, `${upCount}/${totCount} up`, downCount ? `${downCount} down` : ''].filter(Boolean).join(' · ');
|
||||
const upCount = ports.filter(([, p]) => p.up).length;
|
||||
const downCount = ports.length - upCount;
|
||||
const counts = ports.length ? [`${upCount}/${ports.length} up`, downCount ? `${downCount} down` : ''] : [];
|
||||
const meta = [model, ...counts].filter(Boolean).join(' · ');
|
||||
const header = `<div class="chassis-header">
|
||||
<span class="chassis-name">Front panel</span>
|
||||
<span class="chassis-meta">${escHtml(meta)}</span>
|
||||
</div>`;
|
||||
|
||||
// Is this a US24PRO? Used to add group-separator class
|
||||
const isUs24Pro = (model === 'US24PRO');
|
||||
|
||||
let chassisHtml = '';
|
||||
|
||||
if (layout) {
|
||||
const sfpPortSet = new Set(layout.sfp_ports || []);
|
||||
const sfpSectionSet = new Set(layout.sfp_section || []);
|
||||
|
||||
// Main port rows
|
||||
chassisHtml += '<div class="chassis-rows">';
|
||||
for (const row of layout.rows) {
|
||||
const rowCls = isUs24Pro ? ' us24pro-row' : '';
|
||||
chassisHtml += `<div class="chassis-row${rowCls}">`;
|
||||
for (const idx of row) {
|
||||
const port = portMap[idx];
|
||||
const isSfp = sfpPortSet.has(idx);
|
||||
const sfpCls = isSfp ? ' sfp-port' : '';
|
||||
const state = portBlockState(port);
|
||||
const title = port ? escHtml(port.name) : `Port ${idx}`;
|
||||
const speedTxt = portSpeedLabel(port);
|
||||
const lldpName = (port && port.lldp && (port.lldp.system_name || port.lldp.chassis_id))
|
||||
? escHtml((port.lldp.system_name || port.lldp.chassis_id || '').slice(0, 6))
|
||||
: '';
|
||||
const speedHtml = speedTxt ? `<span class="port-speed">${speedTxt}</span>` : '';
|
||||
const lldpHtml = lldpName ? `<span class="port-lldp">${lldpName}</span>` : '';
|
||||
chassisHtml += `<div class="switch-port-block ${state}${sfpCls}"
|
||||
data-switch="${escHtml(swName)}" data-port-idx="${idx}"
|
||||
title="${title}" aria-label="${title}"
|
||||
data-action="select-port"><span class="port-num">${idx}</span>${speedHtml}${lldpHtml}</div>`;
|
||||
}
|
||||
chassisHtml += '</div>';
|
||||
}
|
||||
chassisHtml += '</div>';
|
||||
|
||||
// Separate SFP section (if present)
|
||||
if (sfpSectionSet.size) {
|
||||
chassisHtml += '<div class="chassis-sfp-section">';
|
||||
for (const idx of layout.sfp_section) {
|
||||
chassisHtml += portBlockHtml(idx, portMap[idx], swName, true);
|
||||
}
|
||||
chassisHtml += '</div>';
|
||||
}
|
||||
} else {
|
||||
// Fallback: render all ports sorted by idx
|
||||
const allPorts = Object.entries(sw.ports || {})
|
||||
.sort(([, a], [, b]) => (a.port_idx || 0) - (b.port_idx || 0));
|
||||
chassisHtml += '<div class="chassis-rows"><div class="chassis-row">';
|
||||
for (const [pname, d] of allPorts) {
|
||||
chassisHtml += portBlockHtml(d.port_idx || 0, Object.assign({ name: pname }, d), swName, false);
|
||||
}
|
||||
chassisHtml += '</div></div>';
|
||||
if (FACEPLATES[model]) {
|
||||
return `<div class="inspector-chassis">${header}${renderFaceplate(model, {
|
||||
swName, portMap, outlets: sw.outlets, online: sw.online, titleFor: faceplatePortTitle,
|
||||
})}</div>`;
|
||||
}
|
||||
|
||||
// No faceplate for this model yet: plain blocks in port order
|
||||
const blocks = ports
|
||||
.sort(([, a], [, b]) => (a.port_idx || 0) - (b.port_idx || 0))
|
||||
.map(([pname, d]) => portBlockHtml(d.port_idx || 0, Object.assign({ name: pname }, d), swName, false))
|
||||
.join('');
|
||||
return `
|
||||
<div class="inspector-chassis" id="chassis-${escHtml(swName)}">
|
||||
<div class="chassis-header">
|
||||
<span class="chassis-name">${escHtml(swName)}</span>
|
||||
${sw.ip ? `<span class="chassis-ip">${escHtml(sw.ip)}</span>` : ''}
|
||||
<span class="chassis-meta">${escHtml(meta)}</span>
|
||||
</div>
|
||||
<div class="inspector-chassis">
|
||||
${header}
|
||||
<div class="chassis-body">
|
||||
<div class="chassis-ear-l"></div>
|
||||
<div class="chassis-ear-r"></div>
|
||||
${chassisHtml}
|
||||
<div class="chassis-rows"><div class="chassis-row">${blocks}</div></div>
|
||||
</div>
|
||||
${chassisLegendHtml()}
|
||||
</div>`;
|
||||
@@ -213,27 +161,35 @@ function renderChassis(swName, sw) {
|
||||
let _selectedSwitch = null;
|
||||
let _selectedIdx = null;
|
||||
let _apiData = null;
|
||||
let _diagPollTimer = null;
|
||||
|
||||
// ── Port selection ───────────────────────────────────────────────────────
|
||||
function selectPort(el) {
|
||||
const swName = el.dataset.switch;
|
||||
const idx = parseInt(el.dataset.portIdx, 10);
|
||||
selectPortByIdx(el.dataset.switch, parseInt(el.dataset.portIdx, 10));
|
||||
}
|
||||
|
||||
function selectPortByIdx(swName, idx) {
|
||||
const sw = _apiData && _apiData.unifi_switches[swName];
|
||||
if (!sw || !buildPortIdxMap(sw.ports || {})[idx]) return;
|
||||
if (_diagPollTimer) { clearInterval(_diagPollTimer); _diagPollTimer = null; }
|
||||
document.querySelectorAll('.switch-port-block.selected')
|
||||
.forEach(e => e.classList.remove('selected'));
|
||||
el.classList.add('selected');
|
||||
_selectedSwitch = swName;
|
||||
_selectedIdx = idx;
|
||||
renderPanel(swName, idx);
|
||||
highlightSelectedPort();
|
||||
history.replaceState(null, '', `#port-${idx}`);
|
||||
// On narrow screens the panel sits below the front panel, possibly off screen
|
||||
if (window.matchMedia('(max-width: 900px)').matches) {
|
||||
document.getElementById('inspector-panel').scrollIntoView({ behavior: 'smooth', block: 'nearest' });
|
||||
}
|
||||
}
|
||||
|
||||
function closePanel() {
|
||||
if (_diagPollTimer) { clearInterval(_diagPollTimer); _diagPollTimer = null; }
|
||||
document.getElementById('inspector-panel').classList.remove('open');
|
||||
document.querySelectorAll('.switch-port-block.selected')
|
||||
.forEach(el => el.classList.remove('selected'));
|
||||
_selectedSwitch = null;
|
||||
_selectedIdx = null;
|
||||
highlightSelectedPort();
|
||||
history.replaceState(null, '', window.location.pathname + window.location.search);
|
||||
}
|
||||
|
||||
// ── Render detail panel ──────────────────────────────────────────────────
|
||||
@@ -246,7 +202,7 @@ function renderPanel(swName, idx) {
|
||||
if (!d) return;
|
||||
|
||||
const upStr = d.up ? '<span class="val-good">UP</span>' : '<span class="val-crit">DOWN</span>';
|
||||
const speedStr = d.speed_mbps ? `<span class="val-cyan">${fmtSpeed(d.speed_mbps)}bps</span>` : '–';
|
||||
const speedStr = d.speed_mbps ? `<span class="val-cyan">${fmtShortSpeed(d.speed_mbps)}bps</span>` : '–';
|
||||
const duplexCls = d.full_duplex ? 'val-good' : (d.up ? 'val-warn' : 'val-neutral');
|
||||
const duplexStr = d.up ? `<span class="${duplexCls}">${d.full_duplex ? 'Full' : 'Half'}</span>` : '–';
|
||||
const autoneg = d.autoneg ? 'On' : 'Off';
|
||||
@@ -255,9 +211,8 @@ function renderPanel(swName, idx) {
|
||||
|
||||
// PoE section
|
||||
let poeHtml = '';
|
||||
if (d.poe_class != null) {
|
||||
if (d.poe_power || d.poe_max_power) {
|
||||
const poeMaxStr = d.poe_max_power != null ? ` / max ${d.poe_max_power.toFixed(1)}W` : '';
|
||||
const poeCurStr = (d.poe_power != null && d.poe_power > 0) ? ` / draw <span class="val-amber">${d.poe_power.toFixed(1)}W</span>` : '';
|
||||
poeHtml = `
|
||||
<div class="lt-divider"><span class="lt-divider-label">PoE</span></div>
|
||||
<div class="panel-row"><span class="panel-label">Class</span><span class="panel-val">class ${escHtml(String(d.poe_class))}${poeMaxStr}</span></div>
|
||||
@@ -288,11 +243,11 @@ function renderPanel(swName, idx) {
|
||||
// LLDP + path debug
|
||||
let lldpHtml = '';
|
||||
let pathHtml = '';
|
||||
if (d.lldp && d.lldp.system_name) {
|
||||
if (d.lldp) {
|
||||
const l = d.lldp;
|
||||
lldpHtml = `
|
||||
<div class="lt-divider"><span class="lt-divider-label">LLDP Neighbor</span></div>
|
||||
<div class="panel-row"><span class="panel-label">System</span><span class="panel-val val-cyan">${escHtml(l.system_name)}</span></div>
|
||||
<div class="lt-divider"><span class="lt-divider-label">${l.source === 'unifi-clients' ? 'Neighbor (UniFi client table)' : 'LLDP Neighbor'}</span></div>
|
||||
${l.system_name ? `<div class="panel-row"><span class="panel-label">System</span><span class="panel-val val-cyan"><a class="device-link" href="${escHtml(deviceUrl(l.system_name))}">${escHtml(l.system_name)}</a></span></div>` : ''}
|
||||
${l.port_id ? `<div class="panel-row"><span class="panel-label">Port</span><span class="panel-val">${escHtml(l.port_id)}</span></div>` : ''}
|
||||
${l.port_desc ? `<div class="panel-row"><span class="panel-label">Port Desc</span><span class="panel-val">${escHtml(l.port_desc)}</span></div>` : ''}
|
||||
${l.chassis_id ? `<div class="panel-row"><span class="panel-label">Chassis</span><span class="panel-val">${escHtml(l.chassis_id)}</span></div>` : ''}
|
||||
@@ -325,7 +280,15 @@ function renderPanel(swName, idx) {
|
||||
</div>
|
||||
<div class="diag-results" id="diag-results"></div>` : '';
|
||||
|
||||
// Auto-refresh re-renders this panel. A running poll holds these elements,
|
||||
// and results may be on screen, so carry them over for the same port.
|
||||
const inner = document.getElementById('inspector-panel-inner');
|
||||
const panelKey = `${swName}#${idx}`;
|
||||
const samePort = inner.dataset.port === panelKey;
|
||||
const keptStatus = samePort ? document.getElementById('diag-status') : null;
|
||||
const keptResults = samePort ? document.getElementById('diag-results') : null;
|
||||
const scrollTop = samePort ? inner.scrollTop : 0;
|
||||
inner.dataset.port = panelKey;
|
||||
inner.innerHTML = `
|
||||
<div class="panel-header">
|
||||
<div>
|
||||
@@ -349,6 +312,9 @@ function renderPanel(swName, idx) {
|
||||
${pathHtml}
|
||||
${diagHtml}
|
||||
`;
|
||||
if (keptStatus) document.getElementById('diag-status')?.replaceWith(keptStatus);
|
||||
if (keptResults) document.getElementById('diag-results')?.replaceWith(keptResults);
|
||||
inner.scrollTop = scrollTop;
|
||||
|
||||
document.getElementById('inspector-panel').classList.add('open');
|
||||
}
|
||||
@@ -390,7 +356,7 @@ function buildPathDebug(swName, swPort, serverName, ifaceName, svrData) {
|
||||
const swSpd = swPort.speed_mbps, svrSpd = svrData.speed_mbps;
|
||||
const speedMismatch = swSpd && svrSpd && swSpd > 0 && svrSpd > 0 && swSpd !== svrSpd;
|
||||
const speedWarnHtml = speedMismatch
|
||||
? `<div class="path-mismatch-alert">⚠ SPEED MISMATCH — Switch: ${fmtSpeed(swSpd)} · Server: ${fmtSpeed(svrSpd)}</div>`
|
||||
? `<div class="path-mismatch-alert">⚠ SPEED MISMATCH — Switch: ${fmtShortSpeed(swSpd)} · Server: ${fmtShortSpeed(svrSpd)}</div>`
|
||||
: '';
|
||||
|
||||
return `
|
||||
@@ -400,7 +366,7 @@ function buildPathDebug(swName, swPort, serverName, ifaceName, svrData) {
|
||||
<div class="path-col">
|
||||
<div class="path-col-header">Switch</div>
|
||||
<div class="path-row"><span>Port</span><span>${escHtml(swPort.name)}</span></div>
|
||||
<div class="path-row"><span>Speed</span><span>${fmtSpeed(swPort.speed_mbps)}bps</span></div>
|
||||
<div class="path-row"><span>Speed</span><span>${fmtShortSpeed(swPort.speed_mbps)}bps</span></div>
|
||||
<div class="path-row"><span>TX</span><span>${fmtRate(swPort.tx_bytes_rate)}</span></div>
|
||||
<div class="path-row"><span>RX</span><span>${fmtRate(swPort.rx_bytes_rate)}</span></div>
|
||||
<div class="path-row"><span>TX Err</span><span class="${swErrTx}">${fmtErrors(swPort.tx_errs_rate)}</span></div>
|
||||
@@ -410,7 +376,7 @@ function buildPathDebug(swName, swPort, serverName, ifaceName, svrData) {
|
||||
<div class="path-col">
|
||||
<div class="path-col-header">Server: ${escHtml(serverName)}</div>
|
||||
<div class="path-row"><span>Iface</span><span>${escHtml(ifaceName)}</span></div>
|
||||
<div class="path-row"><span>Speed</span><span>${svrData.speed_mbps ? fmtSpeed(svrData.speed_mbps) + 'bps' : '–'}</span></div>
|
||||
<div class="path-row"><span>Speed</span><span>${svrData.speed_mbps ? fmtShortSpeed(svrData.speed_mbps) + 'bps' : '–'}</span></div>
|
||||
<div class="path-row"><span>TX</span><span>${fmtRate(svrData.tx_bytes_rate)}</span></div>
|
||||
<div class="path-row"><span>RX</span><span>${fmtRate(svrData.rx_bytes_rate)}</span></div>
|
||||
<div class="path-row"><span>TX Err</span><span class="${svrErrTx}">${fmtErrors(svrData.tx_errs_rate)}</span></div>
|
||||
@@ -421,67 +387,65 @@ function buildPathDebug(swName, swPort, serverName, ifaceName, svrData) {
|
||||
</div>`;
|
||||
}
|
||||
|
||||
// ── Render all switches ──────────────────────────────────────────────────
|
||||
function renderInspector(data) {
|
||||
_apiData = data;
|
||||
const main = document.getElementById('inspector-main');
|
||||
const switches = data.unifi_switches || {};
|
||||
|
||||
const updEl = document.getElementById('inspector-updated');
|
||||
if (updEl && data.updated) {
|
||||
const updMs = new Date(_toIso(data.updated));
|
||||
const ageMin = (Date.now() - updMs) / 60000;
|
||||
const timeStr = updMs.toLocaleTimeString();
|
||||
if (ageMin > 15) {
|
||||
updEl.innerHTML = `<span class="g-stale-warn" title="Data is ${Math.floor(ageMin)} minutes old — monitor may be down">⚠ Stale: ${timeStr}</span>`;
|
||||
} else {
|
||||
updEl.textContent = 'Updated: ' + timeStr;
|
||||
}
|
||||
// ── Page integration: device.js supplies this one device's data ──────────
|
||||
function renderPortInspector(detail) {
|
||||
_apiData = {
|
||||
unifi_switches: { [detail.name]: {
|
||||
ip: detail.ip, model: detail.model, ports: detail.ports || {},
|
||||
outlets: detail.info && detail.info.outlets, online: detail.status === 'up',
|
||||
} },
|
||||
hosts: detail.neighbor_hosts || {},
|
||||
};
|
||||
const chassis = document.getElementById('device-chassis');
|
||||
// Auto-refresh redraws the panel, so keep a scrolled panel where the user left it
|
||||
const oldFrame = chassis.querySelector('.fp-scroll');
|
||||
const scrollLeft = oldFrame ? oldFrame.scrollLeft : null;
|
||||
chassis.innerHTML = renderChassis(detail.name, _apiData.unifi_switches[detail.name]);
|
||||
const frame = chassis.querySelector('.fp-scroll');
|
||||
if (frame) frame.scrollLeft = scrollLeft !== null ? scrollLeft : faceplateScrollLeft(detail.model, frame);
|
||||
if (_selectedSwitch === detail.name && _selectedIdx !== null) {
|
||||
renderPanel(_selectedSwitch, _selectedIdx);
|
||||
} else if (_selectedSwitch === null) {
|
||||
openPortFromHash(detail.name);
|
||||
}
|
||||
highlightSelectedPort();
|
||||
}
|
||||
|
||||
if (!Object.keys(switches).length) {
|
||||
main.innerHTML = '<div class="lt-empty-state lt-empty-state--sm"><div class="lt-empty-state-icon">⬡</div><div class="lt-empty-state-title">No switch data available</div><div class="lt-empty-state-body">Monitor may still be initialising.</div></div>';
|
||||
function openPortFromHash(swName) {
|
||||
const m = /^#port-(\d+)$/.exec(window.location.hash);
|
||||
if (m) selectPortByIdx(swName, parseInt(m[1], 10));
|
||||
}
|
||||
|
||||
function highlightSelectedPort() {
|
||||
document.querySelectorAll('[data-action="select-port"]').forEach(el => {
|
||||
el.classList.toggle('selected', parseInt(el.dataset.portIdx, 10) === _selectedIdx);
|
||||
});
|
||||
updateFaceplateReadout();
|
||||
document.querySelectorAll('tr.device-row[data-port-idx]').forEach(row => {
|
||||
row.classList.toggle('is-selected', parseInt(row.dataset.portIdx, 10) === _selectedIdx);
|
||||
});
|
||||
}
|
||||
|
||||
document.addEventListener('keydown', e => {
|
||||
if (e.key === 'Escape' && document.getElementById('inspector-panel').classList.contains('open')) {
|
||||
closePanel();
|
||||
return;
|
||||
}
|
||||
if (e.key !== 'Enter' && e.key !== ' ') return;
|
||||
const block = e.target.closest('[data-action="select-port"]');
|
||||
if (block) { e.preventDefault(); selectPort(block); }
|
||||
});
|
||||
|
||||
main.innerHTML = Object.entries(switches)
|
||||
.map(([swName, sw]) => renderChassis(swName, sw))
|
||||
.join('');
|
||||
|
||||
// Re-apply selection highlight after re-render (dataset compare — no CSS escaping)
|
||||
if (_selectedSwitch && _selectedIdx !== null) {
|
||||
const block = Array.from(document.querySelectorAll('.switch-port-block')).find(
|
||||
el => el.dataset.switch === _selectedSwitch && parseInt(el.dataset.portIdx, 10) === _selectedIdx
|
||||
);
|
||||
if (block) {
|
||||
block.classList.add('selected');
|
||||
renderPanel(_selectedSwitch, _selectedIdx);
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// ── Fetch and render ─────────────────────────────────────────────────────
|
||||
async function loadInspector() {
|
||||
try {
|
||||
const data = await lt.api.get('/api/links');
|
||||
renderInspector(data);
|
||||
} catch (e) {
|
||||
document.getElementById('inspector-main').innerHTML =
|
||||
'<div class="lt-empty-state lt-empty-state--sm"><div class="lt-empty-state-icon">✕</div><div class="lt-empty-state-title">Failed to load inspector data</div></div>';
|
||||
lt.toast.error('Failed to load inspector data');
|
||||
}
|
||||
}
|
||||
|
||||
loadInspector();
|
||||
const _inspInterval = window.gandalfSettings?.refreshInterval ?? 60;
|
||||
if (_inspInterval > 0) lt.autoRefresh.start(loadInspector, Math.max(_inspInterval, 15) * 1000);
|
||||
|
||||
window.onGandalfSettingsChanged = function(s) {
|
||||
lt.autoRefresh.stop();
|
||||
if (s.refreshInterval > 0) lt.autoRefresh.start(loadInspector, Math.max(s.refreshInterval, 15) * 1000);
|
||||
};
|
||||
lt.keys.on('Escape', () => {
|
||||
if (document.getElementById('inspector-panel').classList.contains('open')) closePanel();
|
||||
document.addEventListener('mouseover', e => {
|
||||
const port = e.target.closest && e.target.closest('.fp-port, .fp-outlet');
|
||||
if (port) updateFaceplateReadout(port);
|
||||
});
|
||||
document.addEventListener('mouseout', e => {
|
||||
if (e.target.closest && e.target.closest('.fp-port, .fp-outlet')) updateFaceplateReadout();
|
||||
});
|
||||
document.addEventListener('focusin', e => {
|
||||
const port = e.target.closest && e.target.closest('.fp-port, .fp-outlet');
|
||||
if (port) updateFaceplateReadout(port);
|
||||
});
|
||||
|
||||
document.addEventListener('click', e => {
|
||||
@@ -505,7 +469,6 @@ document.addEventListener('click', e => {
|
||||
});
|
||||
|
||||
// ── Link Diagnostics ─────────────────────────────────────────────────
|
||||
let _diagPollTimer = null;
|
||||
|
||||
function runDiagnostic(swName, portIdx) {
|
||||
const statusEl = document.getElementById('diag-status');
|
||||
@@ -541,7 +504,7 @@ function pollDiagnostic(jobId, statusEl, resultsEl) {
|
||||
statusEl.innerHTML = 'Timed out waiting for results. '
|
||||
+ '<button class="lt-btn lt-btn-ghost lt-btn-sm" id="diag-retry-btn">Retry</button>';
|
||||
document.getElementById('diag-retry-btn')?.addEventListener('click', () => {
|
||||
const sel = document.querySelector('.switch-port-block.selected');
|
||||
const sel = document.querySelector('[data-action="select-port"].selected');
|
||||
if (sel) runDiagnostic(sel.dataset.switch, parseInt(sel.dataset.portIdx));
|
||||
});
|
||||
return;
|
||||
@@ -561,7 +524,7 @@ function pollDiagnostic(jobId, statusEl, resultsEl) {
|
||||
statusEl.innerHTML = 'Error: lost connection while collecting diagnostics. '
|
||||
+ '<button class="lt-btn lt-btn-ghost lt-btn-sm" id="diag-retry-btn">Retry</button>';
|
||||
document.getElementById('diag-retry-btn')?.addEventListener('click', () => {
|
||||
const sel = document.querySelector('.switch-port-block.selected');
|
||||
const sel = document.querySelector('[data-action="select-port"].selected');
|
||||
if (sel) runDiagnostic(sel.dataset.switch, parseInt(sel.dataset.portIdx));
|
||||
});
|
||||
});
|
||||
@@ -612,7 +575,7 @@ function renderDiagnosticResults(d, container) {
|
||||
secs.carrier === '0' ? '<span class="diag-val-bad">NO</span>' : '–';
|
||||
const operstateVal = (secs.operstate || '?').toUpperCase();
|
||||
const opstateCls = secs.operstate === 'up' ? 'diag-val-good' : secs.operstate === 'down' ? 'diag-val-bad' : 'diag-val-warn';
|
||||
const speedVal = eth.speed_mbps ? `<span class="diag-val-good">${fmtSpeed(eth.speed_mbps)}bps</span>` : '<span class="diag-val-warn">–</span>';
|
||||
const speedVal = eth.speed_mbps ? `<span class="diag-val-good">${fmtShortSpeed(eth.speed_mbps)}bps</span>` : '<span class="diag-val-warn">–</span>';
|
||||
const duplexVal = eth.duplex === 'full' ? '<span class="diag-val-good">Full</span>' :
|
||||
eth.duplex === 'half' ? '<span class="diag-val-bad">Half</span>' : '–';
|
||||
const linkDetVal = eth.link_detected === true ? '<span class="diag-val-good">Yes</span>' :
|
||||
@@ -776,7 +739,7 @@ function renderDiagnosticResults(d, container) {
|
||||
<div class="diag-section-header">Switch Port Summary</div>
|
||||
<table class="diag-table">
|
||||
<tr><td>Status</td><td>${swPort.up ? '<span class="diag-val-good">UP</span>' : '<span class="diag-val-bad">DOWN</span>'}</td></tr>
|
||||
<tr><td>Speed</td><td>${swPort.speed_mbps ? fmtSpeed(swPort.speed_mbps) + 'bps' : '–'}</td></tr>
|
||||
<tr><td>Speed</td><td>${swPort.speed_mbps ? fmtShortSpeed(swPort.speed_mbps) + 'bps' : '–'}</td></tr>
|
||||
<tr><td>Duplex</td><td>${swPort.full_duplex ? 'Full' : (swPort.up ? '<span class="diag-val-bad">Half</span>' : '–')}</td></tr>
|
||||
<tr><td>TX Err</td><td>${fmtErrors(swPort.tx_errs_rate)}</td></tr>
|
||||
<tr><td>RX Err</td><td>${fmtErrors(swPort.rx_errs_rate)}</td></tr>
|
||||
@@ -819,5 +782,3 @@ function renderPowerBar(dbm, warnThreshold, critThreshold) {
|
||||
<span class="diag-power-zone-crit" style="left:${critPct.toFixed(1)}%"></span>
|
||||
</span>`;
|
||||
}
|
||||
</script>
|
||||
{% endblock %}
|
||||
@@ -1064,3 +1064,249 @@
|
||||
.inspector-panel.open { width: 100%; }
|
||||
.inspector-panel-inner{ width: 100%; }
|
||||
}
|
||||
|
||||
/* ── WAN modem / fiber panel ──────────────────────────────────────── */
|
||||
.modem-stats {
|
||||
display: grid;
|
||||
grid-template-columns: repeat(4, minmax(0, 1fr));
|
||||
gap: 12px;
|
||||
padding: 12px;
|
||||
}
|
||||
@media (max-width: 700px) {
|
||||
.modem-stats { grid-template-columns: repeat(2, minmax(0, 1fr)); }
|
||||
}
|
||||
.modem-stat { display: flex; flex-direction: column; gap: 2px; min-width: 0; }
|
||||
.modem-stat-label { font-size: .68em; color: var(--text-muted); text-transform: uppercase; letter-spacing: .05em; }
|
||||
.modem-stat-value { font-size: 1.05em; font-weight: bold; overflow-wrap: anywhere; }
|
||||
.modem-stat-note { font-size: .7em; color: var(--text-muted); display: block; }
|
||||
.modem-error { margin: 12px; padding: 8px 10px; border: 1px solid var(--terminal-red, #f44); color: var(--terminal-red, #f44); }
|
||||
.modem-chart { padding: 0 12px 8px; }
|
||||
.modem-chart-title { font-size: .72em; color: var(--text-muted); margin-bottom: 4px; }
|
||||
.modem-chart-title span { margin-left: 8px; opacity: .8; }
|
||||
.modem-chart svg { display: block; width: 100%; height: 70px; border: 1px solid var(--border-color); }
|
||||
.modem-chart svg polyline { stroke: var(--terminal-cyan, #0ff); stroke-width: 1.5; }
|
||||
.modem-chart-empty { padding: 0 12px 8px; font-size: .72em; color: var(--text-muted); }
|
||||
.modem-updated { padding: 0 12px 10px; }
|
||||
|
||||
/* ── Device search (home page) ────────────────────────────────────── */
|
||||
.device-search { position: relative; }
|
||||
.device-search label { display: block; margin-bottom: 6px; }
|
||||
.device-search .lt-search { width: 100%; }
|
||||
.device-search-input { width: 100%; font-size: 1em; padding-top: 10px; padding-bottom: 10px; }
|
||||
.device-search-results {
|
||||
position: absolute; left: 0; right: 0; z-index: 50; margin-top: 4px;
|
||||
background: var(--bg-card, var(--bg-secondary)); border: 1px solid var(--border-color);
|
||||
max-height: 420px; overflow-y: auto;
|
||||
}
|
||||
.device-search-results[hidden] { display: none; }
|
||||
.device-search-row {
|
||||
display: grid; grid-template-columns: 14px minmax(0, 1.4fr) 70px minmax(0, 1fr) minmax(0, 1fr);
|
||||
gap: 10px; align-items: center; padding: 9px 12px; color: inherit; text-decoration: none;
|
||||
border-bottom: 1px solid var(--border-color);
|
||||
}
|
||||
.device-search-row:last-child { border-bottom: 0; }
|
||||
.device-search-row:hover, .device-search-row.is-active { background: var(--bg-tertiary); }
|
||||
.device-search-name { font-weight: bold; overflow-wrap: anywhere; }
|
||||
.device-search-kind { font-size: .72em; color: var(--text-muted); text-transform: uppercase; }
|
||||
.device-search-meta { font-size: .8em; color: var(--text-muted); overflow-wrap: anywhere; }
|
||||
.device-search-empty { padding: 12px; color: var(--text-muted); }
|
||||
@media (max-width: 700px) {
|
||||
.device-search-row { grid-template-columns: 14px minmax(0, 1fr) auto; }
|
||||
.device-search-row .device-search-meta { grid-column: 2 / -1; }
|
||||
}
|
||||
|
||||
/* ── Device page ───────────────────────────────────────────────────── */
|
||||
a.device-link { color: inherit; text-decoration: none; border-bottom: 1px dotted var(--text-muted); }
|
||||
a.device-link:hover { color: var(--text-accent); border-bottom-color: currentColor; }
|
||||
.device-title { display: flex; align-items: center; gap: 10px; overflow-wrap: anywhere; }
|
||||
.device-actions { display: flex; gap: 8px; flex-wrap: wrap; align-items: center; }
|
||||
.device-toolbar { padding: 8px 12px; margin: 0; }
|
||||
.device-table td { vertical-align: middle; }
|
||||
.device-num { white-space: nowrap; font-variant-numeric: tabular-nums; }
|
||||
.device-row--down { opacity: .55; }
|
||||
.device-row-name { overflow-wrap: anywhere; }
|
||||
.device-row-sub { font-size: .72em; color: var(--text-muted); }
|
||||
.device-row-toggle { background: none; border: 0; color: inherit; cursor: pointer; font: inherit; padding: 2px 6px; }
|
||||
.device-row-detail > td { background: var(--bg-tertiary); padding: 10px 14px; }
|
||||
.topo-host[data-host] { cursor: pointer; }
|
||||
|
||||
/* WAN outage list in the modem panel */
|
||||
.modem-outages { padding: 0 12px 8px; }
|
||||
.modem-outages ul { list-style: none; margin: 0; padding: 0; border: 1px solid var(--border-color); }
|
||||
.modem-outages li { display: flex; justify-content: space-between; gap: 12px; padding: 4px 8px; font-size: .8em; }
|
||||
.modem-outages li + li { border-top: 1px solid var(--border-color); }
|
||||
|
||||
.g-section-actions[hidden] { display: none; }
|
||||
/* Rows open a detail panel holding the fields that are hidden here on narrow screens */
|
||||
.device-row-detail .link-stats-grid { grid-template-columns: repeat(auto-fit, minmax(110px, 1fr)); }
|
||||
.device-table th:nth-child(-n+2), .device-table td:nth-child(-n+2) { width: 1%; white-space: nowrap; }
|
||||
@media (max-width: 700px) {
|
||||
.device-col-wide { display: none; }
|
||||
.device-table th, .device-table td { padding-left: 6px; padding-right: 6px; }
|
||||
}
|
||||
.device-search-row.is-active { box-shadow: inset 3px 0 0 var(--terminal-cyan, #0ff); }
|
||||
@media (max-width: 700px) {
|
||||
/* Scroll inside the wrapper rather than squeezing every column to a few letters */
|
||||
#events-table { min-width: 760px; }
|
||||
}
|
||||
|
||||
/* ── Port inspector on the device page ────────────────────────────── */
|
||||
.device-inspector { display: grid; grid-template-columns: minmax(0, 1fr) auto; gap: 14px 16px; align-items: start; }
|
||||
.device-chassis { grid-column: 1; min-width: 0; }
|
||||
.device-port-table { grid-column: 1; min-width: 0; }
|
||||
.device-inspector .inspector-panel { grid-column: 2; grid-row: 1 / span 2; position: sticky; top: 70px; }
|
||||
.device-inspector:not(.has-chassis) .inspector-panel,
|
||||
.device-inspector:not(.has-chassis) .device-chassis { display: none; }
|
||||
tr.device-row[data-port-idx] { cursor: pointer; }
|
||||
tr.device-row.is-selected { background: var(--bg-tertiary); box-shadow: inset 3px 0 0 var(--terminal-cyan, #0ff); }
|
||||
.device-chassis .switch-port-block,
|
||||
.device-chassis .switch-port-block.sfp-port,
|
||||
.device-chassis .switch-port-block.sfp-block { width: 50px; height: 50px; font-size: .68em; gap: 2px; }
|
||||
.device-chassis .port-num { font-size: 1.2em; }
|
||||
.device-chassis .port-speed { font-size: .85em; }
|
||||
.device-chassis .port-lldp { font-size: .8em; max-width: 46px; margin: 0; }
|
||||
@media (max-width: 900px) {
|
||||
.device-inspector { grid-template-columns: minmax(0, 1fr); }
|
||||
.device-inspector .inspector-panel { grid-column: 1; grid-row: auto; position: static; }
|
||||
.device-inspector .inspector-panel.open { width: 100%; }
|
||||
.device-inspector .inspector-panel-inner { width: 100%; max-height: none; }
|
||||
.device-chassis .chassis-ear-l, .device-chassis .chassis-ear-r { display: none; }
|
||||
}
|
||||
|
||||
/* ── Realistic device faceplates (static/faceplates.js) ───────────── */
|
||||
/* Hardware colors are fixed: a silver chassis stays silver in every theme. */
|
||||
.device-chassis { container-type: inline-size; }
|
||||
.fp-wrap { padding: 14px 16px; }
|
||||
.fp-frame { overflow: hidden; border-radius: 3px; box-shadow: 0 2px 10px rgba(0,0,0,.55); }
|
||||
.fp-svg { display: block; width: 100%; height: auto; }
|
||||
/* Too narrow for the whole unit: zoom to the port area so jacks stay tappable.
|
||||
Width = viewBox width / visible width; margin = cropX / visible width. */
|
||||
@container (max-width: 620px) {
|
||||
.fp-crop-udmpro .fp-svg { width: 308.7%; max-width: none; margin-left: -208.7%; }
|
||||
}
|
||||
|
||||
.fp-body { fill: url(#fp-metal); }
|
||||
.fp-vent { fill: #242326; }
|
||||
.fp-screen { fill: #0c1020; stroke: #2a2c34; stroke-width: 1; }
|
||||
.fp-screen-ring{ fill: none; stroke: #3f7bd9; stroke-width: 2.2; }
|
||||
.fp-screen-dot { fill: #dfe8f8; }
|
||||
.fp-brand { fill: #55565c; font: 600 7.5px Arial, Helvetica, sans-serif; }
|
||||
.fp-bay { fill: url(#fp-bay-face); stroke: #54555a; stroke-width: 1; }
|
||||
.fp-bay-edge { fill: #bdbdc1; }
|
||||
.fp-bay-led { fill: #3a3a3e; }
|
||||
.fp-block { fill: #e1e1e3; stroke: #5d5e63; stroke-width: 1; }
|
||||
.fp-divider { fill: #dcdcde; }
|
||||
.fp-label { fill: #55565c; font: 9px Arial, Helvetica, sans-serif; }
|
||||
.fp-label-sm { font-size: 6.5px; letter-spacing: .03em; }
|
||||
.fp-globe { fill: none; stroke: #3f7bd9; stroke-width: .8; }
|
||||
.fp-reset { fill: #1b1b1d; }
|
||||
|
||||
.fp-jack { fill: #18181b; stroke: #0c0c0d; stroke-width: .6; }
|
||||
.fp-contacts { fill: #b89545; }
|
||||
.fp-plug { fill: #9ea1a8; stroke: #5b5d63; stroke-width: .6; }
|
||||
.fp-plug-clip { fill: #7e8087; stroke: #5b5d63; stroke-width: .5; }
|
||||
.fp-cage { fill: #17171a; stroke: #6e6f74; stroke-width: 1; }
|
||||
.fp-cage-spring{ fill: none; stroke: #5d5e63; stroke-width: 1.2; stroke-dasharray: 2.5 1.5; }
|
||||
.fp-cage-rail { fill: #3b3c41; }
|
||||
.fp-module { fill: #a5a7ad; stroke: #6a6b70; stroke-width: .6; }
|
||||
.fp-module-lc { fill: #2a4a7f; stroke: #1a2a44; stroke-width: .5; }
|
||||
|
||||
.fp-led-idle { fill: #6a6b70; }
|
||||
.fp-led-off { fill: #4b4c50; }
|
||||
.fp-led-amber { fill: #ffad1f; }
|
||||
.fp-led-green { fill: #35f06f; }
|
||||
.fp-led-white { fill: #ffffff; stroke: #8fa6c4; stroke-width: .5; }
|
||||
.fp-led-unknown{ fill: #b9bcc2; }
|
||||
.fp-led-amber, .fp-led-green, .fp-led-white { filter: drop-shadow(0 0 1.5px currentColor); }
|
||||
.fp-led-amber { color: #ffad1f; }
|
||||
.fp-led-green { color: #35f06f; }
|
||||
.fp-led-white { color: #cfe2ff; }
|
||||
.fp-led-active { animation: fp-blink 1.3s steps(2, jump-none) infinite; }
|
||||
@keyframes fp-blink { 50% { opacity: .45; } }
|
||||
@media (prefers-reduced-motion: reduce) { .fp-led-active { animation: none; } }
|
||||
|
||||
.fp-port { cursor: pointer; outline: none; }
|
||||
.fp-hit { fill: transparent; stroke: transparent; stroke-width: 2.5; pointer-events: all; }
|
||||
.fp-port:hover .fp-hit { stroke: rgba(0,90,220,.55); }
|
||||
.fp-port:focus-visible .fp-hit,
|
||||
.fp-port.selected .fp-hit { stroke: #0058e0; fill: rgba(0,88,224,.14); }
|
||||
|
||||
.fp-legend-led { width: 12px; height: 5px; border-radius: 1px; display: inline-block; background: #4b4c50; }
|
||||
.fp-legend-led.fp-led-amber { background: #ffad1f; }
|
||||
.fp-legend-led.fp-led-green { background: #35f06f; }
|
||||
.fp-legend-led.fp-led-white { background: #fff; }
|
||||
.fp-readout { margin-left: auto; font-size: .72em; color: var(--text-dim, var(--text-muted)); text-transform: none; letter-spacing: 0; }
|
||||
|
||||
/* Narrow panels: crop to the ports, or scroll within the panel */
|
||||
@container (max-width: 620px) {
|
||||
.fp-crop-agg .fp-svg { width: 437%; max-width: none; margin-left: -337%; }
|
||||
.fp-scroll { overflow-x: auto; }
|
||||
.fp-scroll .fp-svg { width: 260%; max-width: none; }
|
||||
}
|
||||
.fp-desk { box-shadow: none; }
|
||||
.fp-desk .fp-svg { max-width: 560px; margin: 0 auto; filter: drop-shadow(0 3px 6px rgba(0,0,0,.5)); }
|
||||
|
||||
.fp-body-white { fill: #f2f2f3; stroke: #c9c9cc; stroke-width: 1; }
|
||||
.fp-frame-grey { fill: #c6c8cc; stroke: #8b8d92; stroke-width: 1; }
|
||||
.fp-foot { fill: #b7b7ba; }
|
||||
.fp-body-metal { fill: url(#fp-metal); }
|
||||
.fp-ear { fill: #c4c4c7; stroke: #8f9095; stroke-width: 1; }
|
||||
.fp-ear-hole { fill: #0b0d12; }
|
||||
.fp-button { fill: #3a3a3e; stroke: #1b1b1d; stroke-width: 1; }
|
||||
.fp-speed-bar { fill: #8d8e93; }
|
||||
.fp-screen-grid{ fill: none; stroke: #2f6fd0; stroke-width: 1; }
|
||||
.fp-screen-icon{ fill: #6b9be4; }
|
||||
.fp-static { opacity: .85; }
|
||||
.fp-bolt { fill: #e88a00; }
|
||||
.fp-cycle { fill: none; stroke: #0058e0; stroke-width: 1.4; stroke-linecap: round; }
|
||||
|
||||
.fp-outlet { cursor: default; outline: none; }
|
||||
.fp-outlet-face { fill: #2a2a2d; stroke: #111113; stroke-width: 1; }
|
||||
.fp-slot { fill: #050506; }
|
||||
.fp-usbc { fill: #1c1c1f; stroke: #8b8d92; stroke-width: 1; }
|
||||
.fp-usbc-tongue { fill: #b9bcc2; }
|
||||
.fp-outlet-is-off .fp-outlet-face { fill: #5b5c60; }
|
||||
.fp-outlet-is-off .fp-usbc { fill: #66676b; }
|
||||
.fp-outlet:hover .fp-hit { stroke: rgba(0,90,220,.55); }
|
||||
.fp-outlet:focus-visible .fp-hit { stroke: #0058e0; fill: rgba(0,88,224,.14); }
|
||||
.fp-outlet-state { fill: #8d8e93; }
|
||||
.fp-state-on { fill: #12a84a; }
|
||||
.fp-state-off { fill: #d6332a; }
|
||||
|
||||
.fp-ups-band { fill: #8c8d90; }
|
||||
.fp-ups-vent { fill: #2b2b2e; }
|
||||
.fp-ups-rib { fill: none; stroke: #77787c; stroke-width: 1; }
|
||||
.fp-ups-batt { fill: none; stroke: #2b2b2e; stroke-width: 1.3; }
|
||||
.fp-ups-batt-tip{ fill: #2b2b2e; }
|
||||
|
||||
.fp-led-blue { fill: #2f7bff; color: #2f7bff; filter: drop-shadow(0 0 2px currentColor); }
|
||||
.fp-legend-led.fp-led-blue { background: #2f7bff; }
|
||||
.fp-legend-led.fp-led-outlet-on { background: #12a84a; width: 7px; height: 7px; border-radius: 50%; }
|
||||
.fp-legend-led.fp-led-outlet-off { background: #d6332a; width: 7px; height: 7px; border-radius: 50%; }
|
||||
.fp-legend-icon { width: 11px; height: 11px; flex-shrink: 0; }
|
||||
|
||||
/* A white LED needs an edge to show against the light metal around it */
|
||||
polygon.fp-led-white { stroke: #6b7c95; stroke-width: .7; }
|
||||
polygon.fp-led-off { fill: #6b6c71; }
|
||||
.fp-key { fill: none; stroke: #55565c; stroke-width: .8; }
|
||||
.fp-key-amber { fill: #e8762c; stroke: none; }
|
||||
.fp-key-green { fill: #7ec23a; stroke: none; }
|
||||
.fp-ups-bolt { fill: #2b2b2e; }
|
||||
|
||||
/* UPS 2U Pro: front and rear panels stacked */
|
||||
.fp-stack { box-shadow: none; }
|
||||
.fp-caption { fill: #8b96a6; font: 600 10px Arial, Helvetica, sans-serif; letter-spacing: .1em; }
|
||||
.fp-ups-band-light { fill: #f4f4f5; }
|
||||
.fp-power-ring { fill: none; stroke: #8d8e93; stroke-width: 3; }
|
||||
.fp-power-on { stroke: #2f9bff; filter: drop-shadow(0 0 3px #2f9bff); }
|
||||
.fp-power-face { fill: #dcdcde; stroke: #a9a9ad; stroke-width: 1; }
|
||||
.fp-power-icon { fill: none; stroke: #55565c; stroke-width: 1.5; stroke-linecap: round; }
|
||||
.fp-tile { fill: #1f6fff; }
|
||||
.fp-tile-num { fill: #fff; font: 600 9px Arial, Helvetica, sans-serif; }
|
||||
.fp-outlet-is-off .fp-tile { fill: #3a3d46; }
|
||||
.fp-screen-tile-dim{ fill: #2a2d36; }
|
||||
.fp-breaker { fill: #4a4a4e; }
|
||||
.fp-fan { fill: none; stroke: #3a3a3e; stroke-width: 7; }
|
||||
.fp-fan-strut { fill: none; stroke: #c9c9cc; stroke-width: 5; }
|
||||
.fp-epo { fill: #1c1c1f; }
|
||||
.fp-bracket { fill: none; stroke: #55565c; stroke-width: 1; }
|
||||
@@ -0,0 +1,12 @@
|
||||
<section class="g-section" id="modem-section" hidden>
|
||||
<div class="g-section-header">
|
||||
<h2 class="g-section-title">WAN / Fiber</h2>
|
||||
<a class="g-section-actions lt-btn lt-btn-ghost lt-btn-sm" id="modem-device-link" hidden>↗ Details</a>
|
||||
</div>
|
||||
<div class="lt-frame">
|
||||
<span class="lt-frame-bl">╚</span>
|
||||
<span class="lt-frame-br">╝</span>
|
||||
<div class="lt-section-header" id="modem-title">AT&T Gateway</div>
|
||||
<div id="modem-body" aria-live="polite"></div>
|
||||
</div>
|
||||
</section>
|
||||
@@ -5,6 +5,7 @@
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1.0, viewport-fit=cover">
|
||||
<meta name="theme-color" content="#030508">
|
||||
<meta name="robots" content="noindex, nofollow">
|
||||
<link rel="icon" href="data:image/svg+xml,%3Csvg xmlns='http://www.w3.org/2000/svg' viewBox='0 0 16 16'%3E%3Crect width='16' height='16' rx='3' fill='%23030508'/%3E%3Cpath d='M8 2l5 3v6l-5 3-5-3V5z' fill='none' stroke='%2300e5ff' stroke-width='1.5'/%3E%3C/svg%3E">
|
||||
<title>{% block title %}GANDALF{% endblock %} — GANDALF</title>
|
||||
|
||||
<link rel="preconnect" href="https://fonts.googleapis.com">
|
||||
@@ -36,12 +37,6 @@
|
||||
<a href="{{ url_for('index') }}"
|
||||
class="lt-nav-drawer-link{% if request.endpoint == 'index' %} active{% endif %}"
|
||||
{% if request.endpoint == 'index' %}aria-current="page"{% endif %}>Dashboard</a>
|
||||
<a href="{{ url_for('links_page') }}"
|
||||
class="lt-nav-drawer-link{% if request.endpoint == 'links_page' %} active{% endif %}"
|
||||
{% if request.endpoint == 'links_page' %}aria-current="page"{% endif %}>Link Debug</a>
|
||||
<a href="{{ url_for('inspector') }}"
|
||||
class="lt-nav-drawer-link{% if request.endpoint == 'inspector' %} active{% endif %}"
|
||||
{% if request.endpoint == 'inspector' %}aria-current="page"{% endif %}>Inspector</a>
|
||||
{% if user.groups and 'admin' in user.groups %}
|
||||
<a href="{{ url_for('suppressions_page') }}"
|
||||
class="lt-nav-drawer-link{% if request.endpoint == 'suppressions_page' %} active{% endif %}"
|
||||
@@ -84,16 +79,6 @@
|
||||
{% if request.endpoint == 'index' %}aria-current="page"{% endif %}>
|
||||
Dashboard
|
||||
</a>
|
||||
<a href="{{ url_for('links_page') }}"
|
||||
class="lt-nav-link{% if request.endpoint == 'links_page' %} active{% endif %}"
|
||||
{% if request.endpoint == 'links_page' %}aria-current="page"{% endif %}>
|
||||
Link Debug
|
||||
</a>
|
||||
<a href="{{ url_for('inspector') }}"
|
||||
class="lt-nav-link{% if request.endpoint == 'inspector' %} active{% endif %}"
|
||||
{% if request.endpoint == 'inspector' %}aria-current="page"{% endif %}>
|
||||
Inspector
|
||||
</a>
|
||||
{% if user.groups and 'admin' in user.groups %}
|
||||
<a href="{{ url_for('suppressions_page') }}"
|
||||
class="lt-nav-link{% if request.endpoint == 'suppressions_page' %} active{% endif %}"
|
||||
@@ -186,7 +171,7 @@
|
||||
<span class="lt-footer-sep">|</span>
|
||||
<span class="lt-footer-hint"><span class="lt-footer-key">[ S ]</span> SUPPRESS</span>
|
||||
<span class="lt-footer-sep">|</span>
|
||||
{% elif request.endpoint in ('links_page', 'inspector') %}
|
||||
{% elif request.endpoint == 'device_page' %}
|
||||
<span class="lt-footer-hint"><span class="lt-footer-key">[ R ]</span> REFRESH</span>
|
||||
<span class="lt-footer-sep">|</span>
|
||||
{% endif %}
|
||||
@@ -262,7 +247,8 @@
|
||||
<thead><tr><th>Shortcut</th><th>Action</th></tr></thead>
|
||||
<tbody>
|
||||
<tr><td>Ctrl / ⌘ + K</td><td>Command palette</td></tr>
|
||||
<tr><td>R</td><td>Refresh data (Dashboard / Link Debug / Inspector)</td></tr>
|
||||
<tr><td>R</td><td>Refresh data (Dashboard / Device)</td></tr>
|
||||
<tr><td>/</td><td>Search devices (Dashboard)</td></tr>
|
||||
<tr><td>S</td><td>Quick-suppress alert (Dashboard)</td></tr>
|
||||
<tr><td>*</td><td>Open settings</td></tr>
|
||||
<tr><td>?</td><td>Show this help</td></tr>
|
||||
@@ -330,8 +316,6 @@
|
||||
// Command palette
|
||||
lt.cmdPalette.init([
|
||||
{ id: 'nav-dashboard', group: 'Navigate', icon: '~', label: 'Dashboard', action: function() { window.location.href = '/'; } },
|
||||
{ id: 'nav-links', group: 'Navigate', icon: '↗', label: 'Link Debug', action: function() { window.location.href = '/links'; } },
|
||||
{ id: 'nav-inspector', group: 'Navigate', icon: '⬡', label: 'Inspector', action: function() { window.location.href = '/inspector'; } },
|
||||
{ id: 'nav-suppressions', group: 'Navigate', icon: '🔕', label: 'Suppressions', action: function() { window.location.href = '/suppressions'; } },
|
||||
{ id: 'action-refresh', group: 'Actions', icon: '↻', label: 'Refresh Data', kbd: 'R', action: function() { lt.autoRefresh.now(); } },
|
||||
{ id: 'action-suppress', group: 'Actions', icon: '🔕', label: 'New Suppression', kbd: 'S', action: function() { if (typeof openSuppressModal === 'function') openSuppressModal('host','',''); else window.location.href='/suppressions'; } },
|
||||
|
||||
@@ -0,0 +1,56 @@
|
||||
{% extends "base.html" %}
|
||||
{% block title %}{{ device_name }} – GANDALF{% endblock %}
|
||||
|
||||
{% block content %}
|
||||
<div class="lt-page-header">
|
||||
<div>
|
||||
<p class="g-page-sub"><a href="{{ url_for('index') }}">← Dashboard</a></p>
|
||||
<h1 class="lt-page-title device-title">
|
||||
<span id="device-dot" class="dot-unknown"></span>
|
||||
<span>{{ device_name }}</span>
|
||||
</h1>
|
||||
<p class="g-page-sub" id="device-subtitle"></p>
|
||||
</div>
|
||||
<div id="device-actions" class="device-actions"></div>
|
||||
</div>
|
||||
|
||||
<div id="device-root"><div class="link-loading">Loading device</div></div>
|
||||
|
||||
<!-- Outside device-root: auto-refresh must not reset the filter or port panel -->
|
||||
<section class="g-section" id="device-ports" hidden>
|
||||
<div class="g-section-header"><h2 class="g-section-title" id="device-ports-title">Ports</h2></div>
|
||||
<div class="device-inspector" id="device-inspector">
|
||||
<div class="device-chassis" id="device-chassis" role="region" aria-label="Front panel"></div>
|
||||
<div class="inspector-panel" id="inspector-panel" role="complementary" aria-label="Port detail panel">
|
||||
<div class="inspector-panel-inner" id="inspector-panel-inner"></div>
|
||||
</div>
|
||||
<div class="lt-frame device-port-table">
|
||||
<span class="lt-frame-bl">╚</span>
|
||||
<span class="lt-frame-br">╝</span>
|
||||
<div class="lt-toolbar device-toolbar">
|
||||
<div class="lt-toolbar-left">
|
||||
<div class="lt-search">
|
||||
<input type="search" class="lt-input lt-search-input lt-search-input--sm" id="device-table-search"
|
||||
placeholder="Filter…" autocomplete="off" aria-label="Filter ports">
|
||||
</div>
|
||||
<div class="sev-pills" role="group" aria-label="Filter by state">
|
||||
<button type="button" class="pill active" data-device-filter="all" aria-pressed="true">All</button>
|
||||
<button type="button" class="pill" data-device-filter="up" aria-pressed="false">Up</button>
|
||||
<button type="button" class="pill" data-device-filter="problems" aria-pressed="false">Errors (<span id="device-error-count">0</span>)</button>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<div id="device-table-wrap"></div>
|
||||
</div>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
{% include "_modem_panel.html" %}
|
||||
{% endblock %}
|
||||
|
||||
{% block scripts %}
|
||||
<script>const DEVICE_NAME = {{ device_name | tojson }};</script>
|
||||
<script src="{{ url_for('static', filename='faceplates.js') }}"></script>
|
||||
<script src="{{ url_for('static', filename='port-inspector.js') }}"></script>
|
||||
<script src="{{ url_for('static', filename='device.js') }}"></script>
|
||||
{% endblock %}
|
||||
@@ -64,6 +64,17 @@
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- ── Device search ──────────────────────────────────────────────── -->
|
||||
<section class="g-section device-search" id="device-search" role="search">
|
||||
<label class="g-section-title" for="device-search-input">Find a device</label>
|
||||
<div class="lt-search">
|
||||
<input type="search" class="lt-input lt-search-input device-search-input" id="device-search-input"
|
||||
placeholder="Hostname, IP, MAC, model, interface… ( / )" autocomplete="off" spellcheck="false"
|
||||
role="combobox" aria-expanded="false" aria-controls="device-search-results" aria-autocomplete="list">
|
||||
</div>
|
||||
<div class="device-search-results" id="device-search-results" role="listbox" hidden></div>
|
||||
</section>
|
||||
|
||||
<!-- ── Active alerts ─────────────────────────────── (above the fold) -->
|
||||
<section class="g-section">
|
||||
<div class="g-section-header">
|
||||
@@ -166,10 +177,129 @@
|
||||
</div><!-- /.lt-frame -->
|
||||
</section>
|
||||
|
||||
<!-- ── Network topology + host grid ───────────────────────────────── -->
|
||||
<!-- ── WAN / fiber ──────────────────────────────────────────────────── -->
|
||||
{% include "_modem_panel.html" %}
|
||||
|
||||
<!-- ── Hosts ────────────────────────────────────────────────────────── -->
|
||||
<section class="g-section">
|
||||
<div class="g-section-header">
|
||||
<h2 class="g-section-title">Network Hosts</h2>
|
||||
<h2 class="g-section-title">Hosts</h2>
|
||||
</div>
|
||||
<div class="host-grid" id="host-grid">
|
||||
{%- set has_global_sup = suppressions | selectattr('target_type', 'equalto', 'all') | list | length > 0 -%}
|
||||
{% for name, host in snapshot.hosts.items() %}
|
||||
{% set suppressed = suppressions | selectattr('target_name', 'equalto', name) | list %}
|
||||
<div class="host-card host-card-{{ host.status }}" data-host="{{ name }}">
|
||||
<div class="host-card-header">
|
||||
<div class="host-name-row">
|
||||
<span class="host-status-dot dot-{{ host.status }}"></span>
|
||||
<a class="host-name device-link" href="{{ url_for('device_page', name=name) }}">{{ name }}</a>
|
||||
{% if suppressed or has_global_sup %}
|
||||
<span class="badge-suppressed" title="Suppressed">🔕</span>
|
||||
{% endif %}
|
||||
</div>
|
||||
<div class="host-meta">
|
||||
<span class="host-ip">{{ host.ip }}</span>
|
||||
<span class="host-source source-{{ host.source }}">{{ host.source }}</span>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{% if host.interfaces %}
|
||||
<div class="iface-list">
|
||||
{% for iface, state in host.interfaces.items() | sort %}
|
||||
<div class="iface-row">
|
||||
<span class="iface-dot dot-{{ state }}"></span>
|
||||
<span class="iface-name">{{ iface }}</span>
|
||||
<span class="iface-state state-{{ state }}">{{ state }}</span>
|
||||
</div>
|
||||
{% endfor %}
|
||||
</div>
|
||||
{% else %}
|
||||
<div class="host-ping-note">{% if host.source == 'ping' %}ping-only / no node_exporter{% else %}no metrics from node_exporter{% endif %}</div>
|
||||
{% endif %}
|
||||
|
||||
<div class="host-actions">
|
||||
<button class="lt-btn lt-btn-ghost lt-btn-sm btn-suppress"
|
||||
data-sup-type="host"
|
||||
data-sup-name="{{ name }}"
|
||||
data-sup-detail=""
|
||||
aria-label="Suppress alerts for {{ name }}">
|
||||
🔕 Suppress
|
||||
</button>
|
||||
<a href="{{ url_for('device_page', name=name) }}"
|
||||
class="lt-btn lt-btn-secondary lt-btn-sm">
|
||||
↗ Details
|
||||
</a>
|
||||
</div>
|
||||
</div>
|
||||
{% else %}
|
||||
<div class="lt-empty-state lt-empty-state--sm">
|
||||
<div class="lt-empty-state-icon">⌛</div>
|
||||
<div class="lt-empty-state-title">No host data yet</div>
|
||||
<div class="lt-empty-state-body">The monitor daemon may still be starting up.</div>
|
||||
</div>
|
||||
{% endfor %}
|
||||
</div>
|
||||
</section>
|
||||
|
||||
<!-- ── UniFi devices ────────────────────────────────────────────────── -->
|
||||
{% if snapshot.unifi %}
|
||||
<section class="g-section">
|
||||
<div class="g-section-header">
|
||||
<h2 class="g-section-title">UniFi Devices</h2>
|
||||
</div>
|
||||
<div class="lt-frame">
|
||||
<span class="lt-frame-bl">╚</span>
|
||||
<span class="lt-frame-br">╝</span>
|
||||
<div class="lt-section-header">Device Inventory</div>
|
||||
<div class="lt-table-wrap">
|
||||
<table class="lt-table" id="unifi-table">
|
||||
<caption class="lt-sr-only">UniFi network devices</caption>
|
||||
<thead>
|
||||
<tr>
|
||||
<th>Status</th>
|
||||
<th>Name</th>
|
||||
<th>Type</th>
|
||||
<th>Model</th>
|
||||
<th>IP</th>
|
||||
<th>Actions</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody>
|
||||
{% for d in snapshot.unifi %}
|
||||
<tr class="{% if not d.connected %}row-critical{% endif %}">
|
||||
<td>
|
||||
<span class="dot-{{ 'up' if d.connected else 'down' }}"></span>
|
||||
{{ 'ONLINE' if d.connected else 'OFFLINE' }}
|
||||
</td>
|
||||
<td><a class="device-link" href="{{ url_for('device_page', name=d.name) }}"><strong>{{ d.name }}</strong></a></td>
|
||||
<td>{{ d.type }}</td>
|
||||
<td>{{ d.model }}</td>
|
||||
<td>{{ d.ip }}</td>
|
||||
<td>
|
||||
{% if not d.connected %}
|
||||
<button class="lt-btn lt-btn-ghost lt-btn-sm btn-suppress"
|
||||
data-sup-type="unifi_device"
|
||||
data-sup-name="{{ d.name }}"
|
||||
data-sup-detail=""
|
||||
aria-label="Suppress alerts for {{ d.name }}">
|
||||
🔕 Suppress
|
||||
</button>
|
||||
{% endif %}
|
||||
</td>
|
||||
</tr>
|
||||
{% endfor %}
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
</section>
|
||||
{% endif %}
|
||||
|
||||
<!-- ── Network topology ───────────────────────────────── -->
|
||||
<section class="g-section">
|
||||
<div class="g-section-header">
|
||||
<h2 class="g-section-title">Network Topology</h2>
|
||||
<button type="button" class="topo-collapse-btn" id="topo-toggle-btn"
|
||||
aria-expanded="true" aria-controls="topo-collapsible-wrap">▴ Collapse</button>
|
||||
</div>
|
||||
@@ -191,10 +321,28 @@
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- WAN wire: cyan → WAN gradient -->
|
||||
<!-- Fiber wire: Internet → AT&T gateway -->
|
||||
<div class="topo-vc">
|
||||
<div class="topo-vc-wire topo-vc-wire--wan"></div>
|
||||
<span class="topo-vc-label">WAN · 10G SFP+</span>
|
||||
<span class="topo-vc-label">AT&T Fiber</span>
|
||||
</div>
|
||||
|
||||
<!-- ══════════════════════════════════════════════════════════════
|
||||
TIER 1b: AT&T gateway (Rx filled in by updateModem)
|
||||
══════════════════════════════════════════════════════════ -->
|
||||
<div class="topo-tier">
|
||||
<div class="topo-v2-node topo-v2-router" id="topo-modem">
|
||||
<span class="topo-v2-icon">◈</span>
|
||||
<span class="topo-v2-label">BGW320</span>
|
||||
<span class="topo-v2-sub">AT&T Gateway</span>
|
||||
<span class="topo-v2-sub" id="topo-modem-rx">Rx –</span>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- WAN wire: gateway → UDM-Pro -->
|
||||
<div class="topo-vc">
|
||||
<div class="topo-vc-wire topo-vc-wire--wan"></div>
|
||||
<span class="topo-vc-label">WAN · Port 9 · 1G</span>
|
||||
</div>
|
||||
|
||||
<!-- ══════════════════════════════════════════════════════════════
|
||||
@@ -314,126 +462,9 @@
|
||||
</div><!-- /topo-v2 -->
|
||||
</div>
|
||||
|
||||
<!-- Host cards -->
|
||||
<div class="lt-toolbar" id="host-toolbar">
|
||||
<div class="lt-toolbar-left">
|
||||
<div class="lt-search">
|
||||
<input type="search" class="lt-input lt-search-input lt-search-input--sm" id="host-search"
|
||||
placeholder="Filter hosts…" autocomplete="off" aria-label="Filter hosts">
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
<div class="host-grid" id="host-grid">
|
||||
{%- set has_global_sup = suppressions | selectattr('target_type', 'equalto', 'all') | list | length > 0 -%}
|
||||
{% for name, host in snapshot.hosts.items() %}
|
||||
{% set suppressed = suppressions | selectattr('target_name', 'equalto', name) | list %}
|
||||
<div class="host-card host-card-{{ host.status }}" data-host="{{ name }}">
|
||||
<div class="host-card-header">
|
||||
<div class="host-name-row">
|
||||
<span class="host-status-dot dot-{{ host.status }}"></span>
|
||||
<span class="host-name">{{ name }}</span>
|
||||
{% if suppressed or has_global_sup %}
|
||||
<span class="badge-suppressed" title="Suppressed">🔕</span>
|
||||
{% endif %}
|
||||
</div>
|
||||
<div class="host-meta">
|
||||
<span class="host-ip">{{ host.ip }}</span>
|
||||
<span class="host-source source-{{ host.source }}">{{ host.source }}</span>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{% if host.interfaces %}
|
||||
<div class="iface-list">
|
||||
{% for iface, state in host.interfaces.items() | sort %}
|
||||
<div class="iface-row">
|
||||
<span class="iface-dot dot-{{ state }}"></span>
|
||||
<span class="iface-name">{{ iface }}</span>
|
||||
<span class="iface-state state-{{ state }}">{{ state }}</span>
|
||||
</div>
|
||||
{% endfor %}
|
||||
</div>
|
||||
{% else %}
|
||||
<div class="host-ping-note">ping-only / no node_exporter</div>
|
||||
{% endif %}
|
||||
|
||||
<div class="host-actions">
|
||||
<button class="lt-btn lt-btn-ghost lt-btn-sm btn-suppress"
|
||||
data-sup-type="host"
|
||||
data-sup-name="{{ name }}"
|
||||
data-sup-detail=""
|
||||
aria-label="Suppress alerts for {{ name }}">
|
||||
🔕 Suppress
|
||||
</button>
|
||||
<a href="{{ url_for('links_page') }}#{{ name }}"
|
||||
class="lt-btn lt-btn-secondary lt-btn-sm">
|
||||
↗ Links
|
||||
</a>
|
||||
</div>
|
||||
</div>
|
||||
{% else %}
|
||||
<div class="lt-empty-state lt-empty-state--sm">
|
||||
<div class="lt-empty-state-icon">⌛</div>
|
||||
<div class="lt-empty-state-title">No host data yet</div>
|
||||
<div class="lt-empty-state-body">The monitor daemon may still be starting up.</div>
|
||||
</div>
|
||||
{% endfor %}
|
||||
</div>
|
||||
</div><!-- /#topo-collapsible-wrap -->
|
||||
</section>
|
||||
|
||||
<!-- ── UniFi devices ────────────────────────────────────────────────── -->
|
||||
{% if snapshot.unifi %}
|
||||
<section class="g-section">
|
||||
<div class="g-section-header">
|
||||
<h2 class="g-section-title">UniFi Devices</h2>
|
||||
</div>
|
||||
<div class="lt-frame">
|
||||
<span class="lt-frame-bl">╚</span>
|
||||
<span class="lt-frame-br">╝</span>
|
||||
<div class="lt-section-header">Device Inventory</div>
|
||||
<div class="lt-table-wrap">
|
||||
<table class="lt-table" id="unifi-table">
|
||||
<caption class="lt-sr-only">UniFi network devices</caption>
|
||||
<thead>
|
||||
<tr>
|
||||
<th>Status</th>
|
||||
<th>Name</th>
|
||||
<th>Type</th>
|
||||
<th>Model</th>
|
||||
<th>IP</th>
|
||||
<th>Actions</th>
|
||||
</tr>
|
||||
</thead>
|
||||
<tbody>
|
||||
{% for d in snapshot.unifi %}
|
||||
<tr class="{% if not d.connected %}row-critical{% endif %}">
|
||||
<td>
|
||||
<span class="dot-{{ 'up' if d.connected else 'down' }}"></span>
|
||||
{{ 'ONLINE' if d.connected else 'OFFLINE' }}
|
||||
</td>
|
||||
<td><strong>{{ d.name }}</strong></td>
|
||||
<td>{{ d.type }}</td>
|
||||
<td>{{ d.model }}</td>
|
||||
<td>{{ d.ip }}</td>
|
||||
<td>
|
||||
{% if not d.connected %}
|
||||
<button class="lt-btn lt-btn-ghost lt-btn-sm btn-suppress"
|
||||
data-sup-type="unifi_device"
|
||||
data-sup-name="{{ d.name }}"
|
||||
data-sup-detail=""
|
||||
aria-label="Suppress alerts for {{ d.name }}">
|
||||
🔕 Suppress
|
||||
</button>
|
||||
{% endif %}
|
||||
</td>
|
||||
</tr>
|
||||
{% endfor %}
|
||||
</tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
</section>
|
||||
{% endif %}
|
||||
|
||||
<!-- ── Recently Resolved (last 24h) ───────────────────────────────── -->
|
||||
{% if recent_resolved %}
|
||||
@@ -468,6 +499,9 @@
|
||||
|
||||
{% block scripts %}
|
||||
<script>
|
||||
// Load once even when auto-refresh is set to Off
|
||||
refreshModem();
|
||||
|
||||
// Start auto-refresh using saved settings interval (default 30 s)
|
||||
const _savedInterval = window.gandalfSettings?.refreshInterval ?? 30;
|
||||
if (_savedInterval > 0) lt.autoRefresh.start(refreshAll, _savedInterval * 1000);
|
||||
@@ -560,13 +594,12 @@
|
||||
new MutationObserver(applyEventsFilter)
|
||||
.observe(document.getElementById('events-table-wrap'), { childList: true, subtree: true });
|
||||
|
||||
// Host grid search filter
|
||||
document.getElementById('host-search')?.addEventListener('input', function() {
|
||||
const q = this.value.trim().toLowerCase();
|
||||
document.querySelectorAll('#host-grid .host-card').forEach(card => {
|
||||
const name = (card.dataset.host || '').toLowerCase();
|
||||
card.style.display = (!q || name.includes(q)) ? '' : 'none';
|
||||
});
|
||||
initDeviceSearch();
|
||||
|
||||
// Topology hosts open their device page
|
||||
document.getElementById('topology-diagram')?.addEventListener('click', e => {
|
||||
const node = e.target.closest('.topo-host[data-host]');
|
||||
if (node) window.location.href = deviceUrl(node.dataset.host);
|
||||
});
|
||||
|
||||
// Stat card clicks — filter events table by severity
|
||||
|
||||
@@ -1,598 +0,0 @@
|
||||
{% extends "base.html" %}
|
||||
{% block title %}Link Debug – GANDALF{% endblock %}
|
||||
|
||||
{% block content %}
|
||||
|
||||
<div class="lt-page-header">
|
||||
<div>
|
||||
<h1 class="lt-page-title">Link Debug</h1>
|
||||
<p class="g-page-sub">
|
||||
Per-interface stats: speed, duplex, SFP optical levels, TX/RX rates, errors, and carrier changes.
|
||||
<span id="links-updated" class="g-page-sub-aside"></span>
|
||||
</p>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div class="lt-toolbar" id="links-toolbar" style="display:none">
|
||||
<div class="lt-toolbar-left">
|
||||
<div class="lt-search">
|
||||
<input type="search" class="lt-input lt-search-input" id="links-search"
|
||||
placeholder="Filter by host or switch name…" autocomplete="off"
|
||||
aria-label="Filter by host or switch name">
|
||||
</div>
|
||||
</div>
|
||||
<div class="lt-toolbar-right">
|
||||
<button class="lt-btn lt-btn-ghost lt-btn-sm" data-action="collapse-all">Collapse All</button>
|
||||
<button class="lt-btn lt-btn-ghost lt-btn-sm" data-action="expand-all">Expand All</button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div id="links-container">
|
||||
<div class="link-loading">Loading link statistics</div>
|
||||
</div>
|
||||
|
||||
{% endblock %}
|
||||
|
||||
{% block scripts %}
|
||||
<script>
|
||||
const escHtml = s => lt.escHtml(s);
|
||||
|
||||
// ── Formatting helpers ────────────────────────────────────────────
|
||||
function fmtRate(bytesPerSec) {
|
||||
if (bytesPerSec === null || bytesPerSec === undefined) return '–';
|
||||
const bps = bytesPerSec * 8;
|
||||
if (bps < 1e3) return bps.toFixed(0) + ' bps';
|
||||
if (bps < 1e6) return (bps/1e3).toFixed(1) + ' Kbps';
|
||||
if (bps < 1e9) return (bps/1e6).toFixed(2) + ' Mbps';
|
||||
return (bps/1e9).toFixed(3) + ' Gbps';
|
||||
}
|
||||
|
||||
function fmtRateBar(bytesPerSec, linkSpeedMbps) {
|
||||
if (!linkSpeedMbps || linkSpeedMbps <= 0) return 0;
|
||||
const mbps = (bytesPerSec * 8) / 1e6;
|
||||
return Math.min(100, (mbps / linkSpeedMbps) * 100);
|
||||
}
|
||||
|
||||
function trafficBarClass(pct, isTx) {
|
||||
if (pct > 85) return 'lt-progress--red';
|
||||
if (pct > 65) return 'lt-progress--amber';
|
||||
return isTx ? '' : 'lt-progress--cyan';
|
||||
}
|
||||
|
||||
function fmtSpeed(mbps) {
|
||||
if (mbps === null || mbps === undefined) return '–';
|
||||
if (mbps >= 1000) return (mbps/1000).toFixed(0) + ' Gbps';
|
||||
return mbps + ' Mbps';
|
||||
}
|
||||
|
||||
function fmtDuplex(d) {
|
||||
if (!d) return '–';
|
||||
return d.charAt(0).toUpperCase() + d.slice(1);
|
||||
}
|
||||
|
||||
function fmtTemp(c) {
|
||||
if (c === null || c === undefined) return '–';
|
||||
return c.toFixed(1) + ' °C';
|
||||
}
|
||||
|
||||
function fmtVoltage(v) {
|
||||
if (v === null || v === undefined) return '–';
|
||||
return v.toFixed(2) + ' V';
|
||||
}
|
||||
|
||||
function fmtPower(dbm) {
|
||||
if (dbm === null || dbm === undefined) return '–';
|
||||
return dbm.toFixed(2) + ' dBm';
|
||||
}
|
||||
|
||||
function fmtBias(ma) {
|
||||
if (ma === null || ma === undefined) return '–';
|
||||
return ma.toFixed(2) + ' mA';
|
||||
}
|
||||
|
||||
function fmtErrors(rate) {
|
||||
if (rate === null || rate === undefined) return '–';
|
||||
if (rate < 0.001) return '<span class="val-good">0 /s</span>';
|
||||
return `<span class="val-crit">${rate.toFixed(3)} /s</span>`;
|
||||
}
|
||||
|
||||
function fmtCarrier(n) {
|
||||
if (n === null || n === undefined) return '–';
|
||||
if (n === 0) return '<span class="counter-zero">0</span>';
|
||||
return `<span class="counter-nonzero">${n}</span>`;
|
||||
}
|
||||
|
||||
// ── SFP/DOM value classification ─────────────────────────────────
|
||||
function rxPowerClass(dbm) {
|
||||
if (dbm === null || dbm === undefined) return 'val-neutral';
|
||||
if (dbm < -15) return 'val-crit';
|
||||
if (dbm < -10) return 'val-warn';
|
||||
return 'val-good';
|
||||
}
|
||||
function txPowerClass(dbm) {
|
||||
if (dbm === null || dbm === undefined) return 'val-neutral';
|
||||
if (dbm < -5) return 'val-crit';
|
||||
return 'val-good';
|
||||
}
|
||||
function tempClass(c) {
|
||||
if (c === null || c === undefined) return 'val-neutral';
|
||||
if (c > 80) return 'val-crit';
|
||||
if (c > 70) return 'val-warn';
|
||||
return 'val-good';
|
||||
}
|
||||
function voltageClass(v) {
|
||||
if (v === null || v === undefined) return 'val-neutral';
|
||||
if (v < 3.0 || v > 3.6) return 'val-crit';
|
||||
if (v < 3.1 || v > 3.5) return 'val-warn';
|
||||
return 'val-good';
|
||||
}
|
||||
|
||||
function errorBadges(d) {
|
||||
const badges = [];
|
||||
if ((d.tx_errs_rate || 0) > 0.001 || (d.rx_errs_rate || 0) > 0.001)
|
||||
badges.push('<span class="link-alert-badge">ERR</span>');
|
||||
if ((d.tx_drops_rate || 0) > 0.001 || (d.rx_drops_rate || 0) > 0.001)
|
||||
badges.push('<span class="link-alert-badge link-alert-amber">DROP</span>');
|
||||
if ((d.carrier_changes || 0) > 3)
|
||||
badges.push('<span class="link-alert-badge link-alert-amber">FLAP</span>');
|
||||
return badges.join('');
|
||||
}
|
||||
|
||||
// ── Render a single server interface card ─────────────────────────
|
||||
function renderIfaceCard(ifaceName, d) {
|
||||
const isDown = d.link_detected === false;
|
||||
const pt = (d.port_type || '').toUpperCase();
|
||||
const mediaTag = pt === 'FIBRE' || pt === 'SFP' || pt.includes('FIBRE') ? 'type-fibre'
|
||||
: pt === 'DA' ? 'type-da'
|
||||
: 'type-copper';
|
||||
const mediaLabel = d.port_type || '–';
|
||||
const speedStr = d.speed_mbps ? fmtSpeed(d.speed_mbps) : '–';
|
||||
const txPct = fmtRateBar(d.tx_bytes_rate, d.speed_mbps);
|
||||
const rxPct = fmtRateBar(d.rx_bytes_rate, d.speed_mbps);
|
||||
|
||||
let sfpHtml = '';
|
||||
if (d.sfp && Object.keys(d.sfp).length > 0) {
|
||||
const s = d.sfp;
|
||||
const rxClass = rxPowerClass(s.rx_power_dbm);
|
||||
const txClass = txPowerClass(s.tx_power_dbm);
|
||||
const tmpClass = tempClass(s.temp_c);
|
||||
const vClass = voltageClass(s.voltage_v);
|
||||
const rxPct2 = s.rx_power_dbm != null ? Math.min(100, Math.max(0, (s.rx_power_dbm + 20) / 15 * 100)) : 0;
|
||||
const txPct2 = s.tx_power_dbm != null ? Math.min(100, Math.max(0, (s.tx_power_dbm + 10) / 8 * 100)) : 0;
|
||||
|
||||
sfpHtml = `
|
||||
<div class="sfp-panel">
|
||||
<div class="sfp-vendor-row">
|
||||
${s.vendor ? `<span>${escHtml(s.vendor)}</span>` : ''}
|
||||
${s.part_no ? ` / <span>${escHtml(s.part_no)}</span>` : ''}
|
||||
</div>
|
||||
<div class="sfp-grid">
|
||||
<div class="sfp-stat">
|
||||
<span class="sfp-stat-label" data-tooltip="SFP module temperature. Normal: below 70°C. Warn: 70–85°C. Critical: above 85°C.">Temp</span>
|
||||
<span class="sfp-stat-value ${tmpClass}">${fmtTemp(s.temp_c)}</span>
|
||||
</div>
|
||||
<div class="sfp-stat">
|
||||
<span class="sfp-stat-label" data-tooltip="SFP supply voltage. Normal: 3.1–3.5V.">Voltage</span>
|
||||
<span class="sfp-stat-value ${vClass}">${fmtVoltage(s.voltage_v)}</span>
|
||||
</div>
|
||||
<div class="sfp-stat">
|
||||
<span class="sfp-stat-label" data-tooltip="Laser bias current in mA. High values may indicate end-of-life laser diode.">Bias</span>
|
||||
<span class="sfp-stat-value">${fmtBias(s.bias_ma)}</span>
|
||||
</div>
|
||||
<div class="sfp-stat">
|
||||
<span class="sfp-stat-label" data-tooltip="Optical transmit power in dBm. Typical good range: -3 to -9 dBm.">TX Power</span>
|
||||
<span class="sfp-stat-value ${txClass}">${fmtPower(s.tx_power_dbm)}</span>
|
||||
<div class="power-row">
|
||||
<div class="power-track"><div class="power-fill ${txClass === 'val-good' ? 'power-ok' : txClass === 'val-warn' ? 'power-warn' : 'power-crit'}" style="width:${txPct2}%"></div></div>
|
||||
</div>
|
||||
</div>
|
||||
<div class="sfp-stat">
|
||||
<span class="sfp-stat-label" data-tooltip="Optical receive power in dBm. Typical good range: -3 to -18 dBm. Below -20 dBm may indicate dirty/damaged fiber.">RX Power</span>
|
||||
<span class="sfp-stat-value ${rxClass}">${fmtPower(s.rx_power_dbm)}</span>
|
||||
<div class="power-row">
|
||||
<div class="power-track"><div class="power-fill ${rxClass === 'val-good' ? 'power-ok' : rxClass === 'val-warn' ? 'power-warn' : 'power-crit'}" style="width:${rxPct2}%"></div></div>
|
||||
</div>
|
||||
</div>
|
||||
${s.rx_power_dbm != null && s.tx_power_dbm != null ? `
|
||||
<div class="sfp-stat">
|
||||
<span class="sfp-stat-label" data-tooltip="Insertion loss: difference between transmit and receive power. Large negative values indicate fiber loss or connector issues.">RX−TX Δ</span>
|
||||
<span class="sfp-stat-value">${(s.rx_power_dbm - s.tx_power_dbm).toFixed(2)} dBm</span>
|
||||
</div>` : ''}
|
||||
</div>
|
||||
</div>`;
|
||||
}
|
||||
|
||||
return `
|
||||
<div class="link-iface-card ${isDown ? 'port-down' : ''}">
|
||||
<div class="link-iface-header">
|
||||
<span class="link-iface-name">${escHtml(ifaceName)}</span>
|
||||
<span class="link-iface-speed">${speedStr}</span>
|
||||
<span class="link-iface-type ${mediaTag}">${escHtml(mediaLabel)}</span>
|
||||
${errorBadges(d)}
|
||||
</div>
|
||||
<div class="link-stats-grid">
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label">Link</span>
|
||||
<span class="link-stat-value ${isDown ? 'val-crit' : 'val-good'}">${isDown ? 'DOWN' : 'UP'}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label" data-tooltip="Full = simultaneous send/receive at full speed. Half = one direction at a time, can cause collisions.">Duplex</span>
|
||||
<span class="link-stat-value">${fmtDuplex(d.duplex)}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label" data-tooltip="Autonegotiation: NIC and switch automatically agree on link speed and duplex mode.">Auto-neg</span>
|
||||
<span class="link-stat-value">${d.auto_neg == null ? '–' : d.auto_neg ? 'On' : 'Off'}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label" data-tooltip="Carrier changes: number of times the link went up or down. High values indicate a flapping or unstable cable/SFP.">Carrier Δ</span>
|
||||
<span class="link-stat-value">${fmtCarrier(d.carrier_changes)}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label" data-tooltip="Transmit errors per second reported by the kernel network driver.">TX Err/s</span>
|
||||
<span class="link-stat-value">${fmtErrors(d.tx_errs_rate)}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label" data-tooltip="Receive errors per second reported by the kernel network driver.">RX Err/s</span>
|
||||
<span class="link-stat-value">${fmtErrors(d.rx_errs_rate)}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label" data-tooltip="Transmit packets dropped per second (ring buffer full or driver overrun).">TX Drop/s</span>
|
||||
<span class="link-stat-value">${fmtErrors(d.tx_drops_rate)}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label" data-tooltip="Receive packets dropped per second (ring buffer full or driver overrun).">RX Drop/s</span>
|
||||
<span class="link-stat-value">${fmtErrors(d.rx_drops_rate)}</span>
|
||||
</div>
|
||||
</div>
|
||||
<div class="traffic-section">
|
||||
<div class="traffic-row">
|
||||
<span class="traffic-label" data-tooltip="Transmit — outgoing traffic from this server">TX</span>
|
||||
<div class="lt-progress ${trafficBarClass(txPct, true)}"><div class="lt-progress-bar" style="width:${txPct}%"></div></div>
|
||||
<span class="traffic-value">${fmtRate(d.tx_bytes_rate)}</span>
|
||||
</div>
|
||||
<div class="traffic-row">
|
||||
<span class="traffic-label" data-tooltip="Receive — incoming traffic to this server">RX</span>
|
||||
<div class="lt-progress ${trafficBarClass(rxPct, false)}"><div class="lt-progress-bar" style="width:${rxPct}%"></div></div>
|
||||
<span class="traffic-value">${fmtRate(d.rx_bytes_rate)}</span>
|
||||
</div>
|
||||
</div>
|
||||
${sfpHtml}
|
||||
</div>`;
|
||||
}
|
||||
|
||||
// ── Render a single UniFi switch port card ────────────────────────
|
||||
function renderPortCard(portName, d) {
|
||||
const isDown = !d.up;
|
||||
const speedStr = d.speed_mbps ? fmtSpeed(d.speed_mbps) : '–';
|
||||
const txPct = fmtRateBar(d.tx_bytes_rate, d.speed_mbps);
|
||||
const rxPct = fmtRateBar(d.rx_bytes_rate, d.speed_mbps);
|
||||
const numBadge = d.port_idx != null ? `<span class="port-badge port-badge-num">#${d.port_idx}</span>` : '';
|
||||
const uplinkBadge = d.is_uplink ? `<span class="port-badge port-badge-uplink">UPLINK</span>` : '';
|
||||
const poeBadge = d.poe_power ? `<span class="port-badge port-badge-poe">PoE ${d.poe_power.toFixed(1)}W</span>` : '';
|
||||
const lldpLine = d.lldp ? `<div class="port-lldp">→ ${escHtml(d.lldp.system_name || '')} (${escHtml(d.lldp.port_id || '')})</div>` : '';
|
||||
const poeLine = d.poe_class ? `<div class="port-poe-info">PoE ${escHtml(d.poe_class)} · max ${d.poe_max_power != null ? d.poe_max_power.toFixed(1)+'W' : '–'}</div>` : '';
|
||||
|
||||
return `
|
||||
<div class="link-iface-card ${isDown ? 'port-down' : ''}">
|
||||
<div class="link-iface-header">
|
||||
<span class="link-iface-name">${numBadge} ${escHtml(portName)}</span>
|
||||
<span class="link-iface-speed">${speedStr}</span>
|
||||
${uplinkBadge}${poeBadge}
|
||||
${errorBadges(d)}
|
||||
</div>
|
||||
${lldpLine}${poeLine}
|
||||
<div class="link-stats-grid">
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label">Link</span>
|
||||
<span class="link-stat-value ${isDown ? 'val-crit' : 'val-good'}">${isDown ? 'DOWN' : 'UP'}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label">Duplex</span>
|
||||
<span class="link-stat-value">${d.full_duplex == null ? '–' : d.full_duplex ? 'Full' : 'Half'}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label">Auto-neg</span>
|
||||
<span class="link-stat-value">${d.autoneg == null ? '–' : d.autoneg ? 'On' : 'Off'}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label">TX Err/s</span>
|
||||
<span class="link-stat-value">${fmtErrors(d.tx_errs_rate)}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label">RX Err/s</span>
|
||||
<span class="link-stat-value">${fmtErrors(d.rx_errs_rate)}</span>
|
||||
</div>
|
||||
<div class="link-stat">
|
||||
<span class="link-stat-label">TX Drop/s</span>
|
||||
<span class="link-stat-value">${fmtErrors(d.tx_drops_rate)}</span>
|
||||
</div>
|
||||
</div>
|
||||
<div class="traffic-section">
|
||||
<div class="traffic-row">
|
||||
<span class="traffic-label">TX</span>
|
||||
<div class="lt-progress ${trafficBarClass(txPct, true)}"><div class="lt-progress-bar" style="width:${txPct}%"></div></div>
|
||||
<span class="traffic-value">${fmtRate(d.tx_bytes_rate)}</span>
|
||||
</div>
|
||||
<div class="traffic-row">
|
||||
<span class="traffic-label">RX</span>
|
||||
<div class="lt-progress ${trafficBarClass(rxPct, false)}"><div class="lt-progress-bar" style="width:${rxPct}%"></div></div>
|
||||
<span class="traffic-value">${fmtRate(d.rx_bytes_rate)}</span>
|
||||
</div>
|
||||
</div>
|
||||
</div>`;
|
||||
}
|
||||
|
||||
// ── Render all UniFi switches ─────────────────────────────────────
|
||||
function renderUnifiSwitches(unifiSwitches, dataUpdated) {
|
||||
if (!unifiSwitches || !Object.keys(unifiSwitches).length) return '';
|
||||
const updStr = dataUpdated
|
||||
? new Date(_toIso(dataUpdated)).toLocaleTimeString()
|
||||
: '';
|
||||
const html = Object.entries(unifiSwitches).map(([swName, sw]) => {
|
||||
const ports = sw.ports || {};
|
||||
const portValues = Object.values(ports);
|
||||
const portCards = Object.entries(ports)
|
||||
.sort(([,a],[,b]) => (a.port_idx||0) - (b.port_idx||0))
|
||||
.map(([pname, d]) => renderPortCard(pname, d)).join('');
|
||||
const poe_total_w = portValues.reduce((s, p) => s + (p.poe_power || 0), 0);
|
||||
const poe_max_w = portValues.reduce((s, p) => s + (p.poe_max_power || 0), 0);
|
||||
const poeLoad = poe_total_w > 0 ? ` · PoE ${poe_total_w.toFixed(1)}W` : '';
|
||||
|
||||
// PoE utilisation bar
|
||||
let poebar = '';
|
||||
if (poe_total_w > 0 && poe_max_w > 0) {
|
||||
const pct = Math.min(100, (poe_total_w / poe_max_w) * 100);
|
||||
const cls = pct > 80 ? 'poe-bar-crit' : pct > 60 ? 'poe-bar-warn' : 'poe-bar-ok';
|
||||
poebar = `<div class="poe-bar-track"><div class="poe-bar-fill ${cls}" style="width:${pct}%"></div></div>`;
|
||||
}
|
||||
|
||||
return `
|
||||
<div class="link-host-panel" id="panel-${CSS.escape(swName)}">
|
||||
<div class="link-host-title" data-action="toggle-panel" role="button" tabindex="0" aria-expanded="true">
|
||||
<span class="link-host-name">${escHtml(swName)}</span>
|
||||
<span class="link-host-ip">${escHtml(sw.ip || '')}</span>
|
||||
<span class="link-host-upd">${escHtml(sw.model || '')}${updStr ? ' · ' + updStr : ''}${poeLoad}</span>
|
||||
${poebar}
|
||||
<span class="panel-toggle">[–]</span>
|
||||
</div>
|
||||
<div class="link-ifaces-grid">${portCards}</div>
|
||||
</div>`;
|
||||
}).join('');
|
||||
|
||||
return `<div class="lt-divider lt-divider--unifi"><span class="lt-divider-label lt-divider-label--unifi">UNIFI SWITCH PORTS</span></div>${html}`;
|
||||
}
|
||||
|
||||
// ── Panel collapse / expand ───────────────────────────────────────
|
||||
function togglePanel(panel) {
|
||||
panel.classList.toggle('collapsed');
|
||||
const isCollapsed = panel.classList.contains('collapsed');
|
||||
const btn = panel.querySelector('.panel-toggle');
|
||||
const title = panel.querySelector('.link-host-title');
|
||||
if (btn) btn.textContent = isCollapsed ? '[+]' : '[–]';
|
||||
if (title) title.setAttribute('aria-expanded', isCollapsed ? 'false' : 'true');
|
||||
const id = panel.id;
|
||||
if (id) {
|
||||
let collapsed = {};
|
||||
try { collapsed = JSON.parse(sessionStorage.getItem('linksCollapsed') || '{}'); } catch(_) {}
|
||||
collapsed[id] = panel.classList.contains('collapsed');
|
||||
try { sessionStorage.setItem('linksCollapsed', JSON.stringify(collapsed)); } catch(_) {}
|
||||
}
|
||||
}
|
||||
|
||||
function restoreCollapseState() {
|
||||
let collapsed = {};
|
||||
try { collapsed = JSON.parse(sessionStorage.getItem('linksCollapsed') || '{}'); } catch(_) {}
|
||||
for (const [id, isCollapsed] of Object.entries(collapsed)) {
|
||||
const panel = document.getElementById(id);
|
||||
if (!panel) continue;
|
||||
if (isCollapsed) {
|
||||
panel.classList.add('collapsed');
|
||||
const btn = panel.querySelector('.panel-toggle');
|
||||
const title = panel.querySelector('.link-host-title');
|
||||
if (btn) btn.textContent = '[+]';
|
||||
if (title) title.setAttribute('aria-expanded', 'false');
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// ── Build summary stats header ────────────────────────────────────
|
||||
function buildLinkSummary(hosts, unifiSwitches) {
|
||||
let totalIfaces = 0, downIfaces = 0, errIfaces = 0, totalPoe = 0;
|
||||
for (const ifaces of Object.values(hosts || {})) {
|
||||
for (const d of Object.values(ifaces)) {
|
||||
totalIfaces++;
|
||||
if (d.link_detected === false) downIfaces++;
|
||||
if ((d.tx_errs_rate || 0) > 0 || (d.rx_errs_rate || 0) > 0) errIfaces++;
|
||||
}
|
||||
}
|
||||
let swTotal = 0, swDown = 0;
|
||||
for (const sw of Object.values(unifiSwitches || {})) {
|
||||
for (const p of Object.values(sw.ports || {})) {
|
||||
totalPoe += p.poe_power || 0;
|
||||
swTotal++;
|
||||
if (!p.up) swDown++;
|
||||
}
|
||||
}
|
||||
const allTotal = totalIfaces + swTotal;
|
||||
const allDown = downIfaces + swDown;
|
||||
const downCls = allDown > 0 ? 'lt-text-red' : 'lt-text-green';
|
||||
const errCls = errIfaces > 0 ? 'lt-text-amber' : 'lt-text-green';
|
||||
const downCardCls = allDown > 0 ? ' lt-stat-card--alert' : '';
|
||||
const poeCard = totalPoe > 0 ? `
|
||||
<div class="lt-stat-card">
|
||||
<span class="lt-stat-icon lt-text-amber" aria-hidden="true">⚡</span>
|
||||
<div class="lt-stat-info">
|
||||
<span class="lt-stat-value lt-text-amber">${totalPoe.toFixed(1)}</span>
|
||||
<span class="lt-stat-label">PoE Load (W)</span>
|
||||
</div>
|
||||
</div>` : '';
|
||||
return `
|
||||
<div class="lt-stats-grid lt-stats-grid--mb">
|
||||
<div class="lt-stat-card">
|
||||
<span class="lt-stat-icon lt-text-cyan" aria-hidden="true">⬡</span>
|
||||
<div class="lt-stat-info">
|
||||
<span class="lt-stat-value lt-text-cyan">${allTotal}</span>
|
||||
<span class="lt-stat-label">Interfaces</span>
|
||||
</div>
|
||||
</div>
|
||||
<div class="lt-stat-card${downCardCls}">
|
||||
<span class="lt-stat-icon ${downCls}" aria-hidden="true">●</span>
|
||||
<div class="lt-stat-info">
|
||||
<span class="lt-stat-value ${downCls}">${allDown}</span>
|
||||
<span class="lt-stat-label">Ports Down</span>
|
||||
</div>
|
||||
</div>
|
||||
<div class="lt-stat-card">
|
||||
<span class="lt-stat-icon ${errCls}" aria-hidden="true">▲</span>
|
||||
<div class="lt-stat-info">
|
||||
<span class="lt-stat-value ${errCls}">${errIfaces}</span>
|
||||
<span class="lt-stat-label">With Errors</span>
|
||||
</div>
|
||||
</div>
|
||||
${poeCard}
|
||||
</div>`;
|
||||
}
|
||||
|
||||
// ── Main render ───────────────────────────────────────────────────
|
||||
function renderLinks(data) {
|
||||
const hosts = data.hosts || {};
|
||||
const unifiSwitches = data.unifi_switches || {};
|
||||
const parts = [];
|
||||
|
||||
parts.push(buildLinkSummary(hosts, unifiSwitches));
|
||||
parts.push('<div class="link-host-list">');
|
||||
|
||||
for (const [hostname, ifaces] of Object.entries(hosts)) {
|
||||
const ifaceCards = Object.entries(ifaces)
|
||||
.sort(([a],[b]) => a.localeCompare(b))
|
||||
.map(([iname, d]) => renderIfaceCard(iname, d)).join('');
|
||||
const sample = Object.values(ifaces)[0] || {};
|
||||
const ip = sample.host_ip || '';
|
||||
const updStr = data.updated
|
||||
? new Date(_toIso(data.updated)).toLocaleTimeString()
|
||||
: '';
|
||||
|
||||
parts.push(`
|
||||
<div class="link-host-panel" id="panel-${CSS.escape(hostname)}">
|
||||
<div class="link-host-title" data-action="toggle-panel" role="button" tabindex="0" aria-expanded="true">
|
||||
<span class="link-host-name">${escHtml(hostname)}</span>
|
||||
<span class="link-host-ip">${escHtml(ip)}</span>
|
||||
<span class="link-host-upd">${updStr}</span>
|
||||
<span class="panel-toggle">[–]</span>
|
||||
</div>
|
||||
<div class="link-ifaces-grid">${ifaceCards}</div>
|
||||
</div>`);
|
||||
}
|
||||
|
||||
parts.push(renderUnifiSwitches(unifiSwitches, data.updated));
|
||||
parts.push('</div>');
|
||||
document.getElementById('links-container').innerHTML = parts.join('');
|
||||
restoreCollapseState();
|
||||
document.getElementById('links-toolbar').style.display = '';
|
||||
applyLinksSearch();
|
||||
}
|
||||
|
||||
// ── Host/switch search filter ─────────────────────────────────────
|
||||
function applyLinksSearch() {
|
||||
const q = (document.getElementById('links-search')?.value || '').trim().toLowerCase();
|
||||
document.querySelectorAll('.link-host-panel').forEach(panel => {
|
||||
const text = (panel.querySelector('.link-host-name')?.textContent || '').toLowerCase();
|
||||
panel.style.display = (!q || text.includes(q)) ? '' : 'none';
|
||||
});
|
||||
}
|
||||
|
||||
function collapseAll() {
|
||||
document.querySelectorAll('.link-host-panel').forEach(p => {
|
||||
p.classList.add('collapsed');
|
||||
const btn = p.querySelector('.panel-toggle');
|
||||
const title = p.querySelector('.link-host-title');
|
||||
if (btn) btn.textContent = '[+]';
|
||||
if (title) title.setAttribute('aria-expanded', 'false');
|
||||
});
|
||||
try {
|
||||
sessionStorage.setItem('linksCollapsed', JSON.stringify(
|
||||
Object.fromEntries([...document.querySelectorAll('.link-host-panel')].map(p => [p.id, true]))
|
||||
));
|
||||
} catch(_) {}
|
||||
}
|
||||
|
||||
function expandAll() {
|
||||
document.querySelectorAll('.link-host-panel').forEach(p => {
|
||||
p.classList.remove('collapsed');
|
||||
const btn = p.querySelector('.panel-toggle');
|
||||
const title = p.querySelector('.link-host-title');
|
||||
if (btn) btn.textContent = '[–]';
|
||||
if (title) title.setAttribute('aria-expanded', 'true');
|
||||
});
|
||||
try { sessionStorage.setItem('linksCollapsed', '{}'); } catch(_) {}
|
||||
}
|
||||
|
||||
// ── Stale data warning ────────────────────────────────────────────
|
||||
function checkLinksStale(updatedStr) {
|
||||
if (!updatedStr) return;
|
||||
const age = (Date.now() - new Date(_toIso(updatedStr))) / 1000;
|
||||
let banner = document.getElementById('links-stale-banner');
|
||||
if (age > 120) {
|
||||
if (!banner) {
|
||||
banner = document.createElement('div');
|
||||
banner.id = 'links-stale-banner';
|
||||
banner.className = 'lt-alert lt-alert--warning';
|
||||
banner.innerHTML = '<span class="lt-alert-icon">⚠</span><div class="lt-alert-body"><div class="lt-alert-msg"></div></div>';
|
||||
document.getElementById('links-container').prepend(banner);
|
||||
}
|
||||
banner.querySelector('.lt-alert-msg').textContent =
|
||||
`Link data may be stale — last updated ${Math.floor(age/60)}m ago.`;
|
||||
banner.style.display = '';
|
||||
} else if (banner) {
|
||||
banner.style.display = 'none';
|
||||
}
|
||||
}
|
||||
|
||||
// ── Fetch + render ────────────────────────────────────────────────
|
||||
async function loadLinks() {
|
||||
try {
|
||||
const data = await lt.api.get('/api/links');
|
||||
if ((!data.hosts || !Object.keys(data.hosts).length) && (!data.unifi_switches || !Object.keys(data.unifi_switches).length)) {
|
||||
document.getElementById('links-container').innerHTML =
|
||||
'<div class="link-no-data">No link data yet — monitor has not completed a full cycle.</div>';
|
||||
return;
|
||||
}
|
||||
const updEl = document.getElementById('links-updated');
|
||||
if (updEl && data.updated) {
|
||||
updEl.textContent = 'Updated: ' + new Date(_toIso(data.updated)).toLocaleTimeString();
|
||||
}
|
||||
renderLinks(data);
|
||||
checkLinksStale(data.updated);
|
||||
} catch (e) {
|
||||
document.getElementById('links-container').innerHTML =
|
||||
'<div class="error-state">Network error loading link statistics.</div>';
|
||||
lt.toast.error('Failed to load link statistics');
|
||||
}
|
||||
}
|
||||
|
||||
loadLinks();
|
||||
const _linksInterval = window.gandalfSettings?.refreshInterval ?? 60;
|
||||
if (_linksInterval > 0) lt.autoRefresh.start(loadLinks, Math.max(_linksInterval, 15) * 1000);
|
||||
|
||||
window.onGandalfSettingsChanged = function(s) {
|
||||
lt.autoRefresh.stop();
|
||||
if (s.refreshInterval > 0) lt.autoRefresh.start(loadLinks, Math.max(s.refreshInterval, 15) * 1000);
|
||||
};
|
||||
|
||||
document.addEventListener('click', e => {
|
||||
const toggleTitle = e.target.closest('[data-action="toggle-panel"]');
|
||||
if (toggleTitle) { togglePanel(toggleTitle.closest('.link-host-panel')); return; }
|
||||
|
||||
if (e.target.closest('[data-action="collapse-all"]')) { collapseAll(); return; }
|
||||
if (e.target.closest('[data-action="expand-all"]')) { expandAll(); return; }
|
||||
});
|
||||
|
||||
document.addEventListener('keydown', e => {
|
||||
if (e.key !== 'Enter' && e.key !== ' ') return;
|
||||
const toggleTitle = e.target.closest('[data-action="toggle-panel"]');
|
||||
if (toggleTitle) { e.preventDefault(); togglePanel(toggleTitle.closest('.link-host-panel')); }
|
||||
});
|
||||
|
||||
document.getElementById('links-search')?.addEventListener('input', applyLinksSearch);
|
||||
</script>
|
||||
{% endblock %}
|
||||
@@ -0,0 +1,128 @@
|
||||
"""Tests for app.py routes: database and LDAP are mocked."""
|
||||
import json
|
||||
import os
|
||||
import sys
|
||||
from unittest.mock import patch
|
||||
|
||||
import pytest
|
||||
|
||||
sys.path.insert(0, os.path.dirname(os.path.dirname(__file__)))
|
||||
|
||||
import app as gandalf # noqa: E402
|
||||
|
||||
AUTH = {'Remote-User': 'jared', 'Remote-Name': 'Jared V', 'Remote-Groups': 'admin'}
|
||||
STATE = {
|
||||
'network_snapshot': json.dumps({
|
||||
'hosts': {'large1': {'ip': '10.0.0.2', 'status': 'up', 'source': 'prometheus', 'interfaces': {'eth0': 'up'}}},
|
||||
'unifi': [{'name': 'USW Flex', 'type': 'usw', 'model': 'USF5P', 'ip': '10.0.0.3', 'mac': '',
|
||||
'connected': True}],
|
||||
}),
|
||||
'link_stats': json.dumps({'hosts': {}, 'unifi_switches': {}}),
|
||||
}
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def client():
|
||||
with patch.object(gandalf, 'db') as db:
|
||||
db.get_state.side_effect = lambda key, default=None: STATE.get(key, default)
|
||||
db.get_active_events.return_value = []
|
||||
db.get_recent_resolved.return_value = []
|
||||
db.get_active_suppressions.return_value = []
|
||||
db.get_events_for_target.return_value = []
|
||||
db.count_active_events.return_value = 0
|
||||
db.get_status_summary.return_value = {'critical': 0, 'warning': 0, 'info': 0, 'resolved_24h': 0}
|
||||
db.check_suppressed.return_value = False
|
||||
with patch.object(gandalf, '_cfg', {'auth': {'allowed_groups': ['admin']}, 'ticket_api': {}}):
|
||||
yield gandalf.app.test_client()
|
||||
|
||||
|
||||
class TestPagesAndNav:
|
||||
def test_home_has_search_and_no_link_debug(self, client):
|
||||
html = client.get('/', headers=AUTH).get_data(as_text=True)
|
||||
assert 'id="device-search-input"' in html
|
||||
assert 'Link Debug' not in html
|
||||
|
||||
def test_home_section_order(self, client):
|
||||
html = client.get('/', headers=AUTH).get_data(as_text=True)
|
||||
order = [html.index(m) for m in (
|
||||
'id="device-search"', 'Alert Queue', 'WAN / Fiber', 'g-section-title">Hosts<',
|
||||
'Device Inventory', 'Network Topology',
|
||||
)]
|
||||
assert order == sorted(order)
|
||||
|
||||
def test_old_links_url_redirects_home(self, client):
|
||||
resp = client.get('/links', headers=AUTH)
|
||||
assert resp.status_code == 302 and resp.headers['Location'].endswith('/')
|
||||
|
||||
def test_device_page_escapes_name(self, client):
|
||||
html = client.get('/device/%3Cscript%3Ex', headers=AUTH).get_data(as_text=True)
|
||||
assert '<script>x' not in html
|
||||
|
||||
def test_old_inspector_url_redirects_home(self, client):
|
||||
resp = client.get('/inspector', headers=AUTH)
|
||||
assert resp.status_code == 302 and resp.headers['Location'].endswith('/')
|
||||
|
||||
def test_nav_has_no_inspector_link(self, client):
|
||||
assert '>Inspector<' not in client.get('/', headers=AUTH).get_data(as_text=True)
|
||||
assert 'Inspector' not in client.get('/device/large1', headers=AUTH).get_data(as_text=True).split('</nav>')[0]
|
||||
|
||||
def test_device_page_loads_the_port_inspector(self, client):
|
||||
html = client.get('/device/large1', headers=AUTH).get_data(as_text=True)
|
||||
assert 'port-inspector.js' in html and 'id="inspector-panel"' in html
|
||||
|
||||
def test_faceplates_load_before_the_port_inspector(self, client):
|
||||
html = client.get('/device/large1', headers=AUTH).get_data(as_text=True)
|
||||
assert html.index('faceplates.js') < html.index('port-inspector.js')
|
||||
|
||||
def test_link_data_api_remains(self, client):
|
||||
assert client.get('/api/links', headers=AUTH).status_code == 200
|
||||
|
||||
|
||||
class TestDeviceApi:
|
||||
def test_requires_auth(self, client):
|
||||
assert client.get('/api/devices').status_code == 401
|
||||
assert client.get('/api/device/large1').status_code == 401
|
||||
|
||||
def test_index_lists_devices(self, client):
|
||||
names = [d['name'] for d in client.get('/api/devices', headers=AUTH).get_json()['devices']]
|
||||
assert names == ['large1', 'USW Flex']
|
||||
|
||||
def test_name_with_a_space(self, client):
|
||||
d = client.get('/api/device/USW%20Flex', headers=AUTH).get_json()
|
||||
assert d['kind'] == 'switch' and d['events'] == []
|
||||
|
||||
def test_unknown_device_is_404(self, client):
|
||||
assert client.get('/api/device/nope', headers=AUTH).status_code == 404
|
||||
|
||||
|
||||
class TestAvatarLogging:
|
||||
def test_missing_ldap_config_says_why(self, client, caplog):
|
||||
assert client.get('/api/avatar', headers=AUTH).status_code == 404
|
||||
assert 'no ldap' in caplog.text
|
||||
|
||||
|
||||
class TestDatabaseTimeZone:
|
||||
def test_sessions_run_in_utc(self):
|
||||
import db as real_db
|
||||
with patch.object(real_db.pymysql, 'connect') as connect:
|
||||
real_db._new_conn({'host': 'h', 'user': 'u', 'password': 'p', 'name': 'n'})
|
||||
assert connect.call_args.kwargs['init_command'] == "SET time_zone='+00:00'"
|
||||
|
||||
|
||||
class TestDiagnoseWithResolvedNeighbor:
|
||||
LINKS = json.dumps({
|
||||
'hosts': {'large1': {'enp35s0': {'host_ip': '10.0.0.2'}}},
|
||||
'unifi_switches': {'sw': {'ports': {'Port 4': {
|
||||
'port_idx': 4, 'up': True,
|
||||
'lldp': {'system_name': 'large1', 'port_id': 'enp35s0', 'chassis_id': 'aa:bb:cc:dd:ee:ff'},
|
||||
}}}},
|
||||
})
|
||||
|
||||
def test_port_with_a_named_neighbor_starts_a_job(self, client):
|
||||
STATE['link_stats'], saved = self.LINKS, STATE['link_stats']
|
||||
try:
|
||||
with patch.object(gandalf.threading, 'Thread'):
|
||||
resp = client.post('/api/diagnose', json={'switch_name': 'sw', 'port_idx': 4}, headers=AUTH)
|
||||
finally:
|
||||
STATE['link_stats'] = saved
|
||||
assert resp.status_code == 200 and resp.get_json()['job_id']
|
||||
@@ -0,0 +1,208 @@
|
||||
"""Tests for devices.py: the inventory behind search and device pages."""
|
||||
import os
|
||||
import sys
|
||||
|
||||
sys.path.insert(0, os.path.dirname(os.path.dirname(__file__)))
|
||||
|
||||
import devices # noqa: E402
|
||||
|
||||
SNAPSHOT = {
|
||||
'hosts': {
|
||||
'large1': {'ip': '10.0.0.2', 'status': 'degraded', 'source': 'prometheus',
|
||||
'interfaces': {'eth0': 'up', 'eth1': 'down'}},
|
||||
},
|
||||
'unifi': [
|
||||
{'name': 'Dream Machine Pro', 'type': 'udm', 'model': 'UDMPRO', 'ip': '203.0.113.5',
|
||||
'mac': 'aa:bb:cc:dd:ee:ff', 'connected': True},
|
||||
{'name': '24RJ45-POE', 'type': 'usw', 'model': 'US24PRO', 'ip': '10.0.0.40',
|
||||
'mac': '11:22:33:44:55:66', 'connected': False},
|
||||
{'name': 'RPDU', 'type': 'usw', 'model': 'USPPDUP', 'ip': '10.0.0.50', 'mac': '', 'connected': True},
|
||||
{'name': 'AP', 'type': 'uap', 'model': 'UAL6', 'ip': '10.0.0.60', 'mac': '', 'connected': True},
|
||||
],
|
||||
}
|
||||
LINKS = {
|
||||
'hosts': {'large1': {'eth0': {'host_ip': '10.0.0.2', 'speed_mbps': 1000}}},
|
||||
'unifi_switches': {
|
||||
'24RJ45-POE': {'ip': '10.0.0.40', 'model': 'US24PRO', 'ports': {
|
||||
'Port 3': {'port_idx': 3, 'up': True, 'speed_mbps': 1000,
|
||||
'lldp': {'system_name': 'large1', 'port_id': 'eth0'}},
|
||||
'Port 4': {'port_idx': 4, 'up': False, 'lldp': None},
|
||||
}},
|
||||
},
|
||||
'unifi_devices': {'Dream Machine Pro': {'firmware': '6.0.17', 'wan': {'wan1': {'up': True}}}},
|
||||
'updated': '2026-11-05 00:00:00 UTC',
|
||||
}
|
||||
MODEM = {'name': 'att-modem', 'reachable': True, 'lan_ip': '192.168.1.254', 'wan_ip': '203.0.113.5',
|
||||
'model': 'BGW320-505', 'wan_problems': []}
|
||||
|
||||
|
||||
def index():
|
||||
return {d['name']: d for d in devices.build_index(SNAPSHOT, LINKS, MODEM)}
|
||||
|
||||
|
||||
class TestKinds:
|
||||
def test_kinds(self):
|
||||
i = index()
|
||||
assert i['large1']['kind'] == 'host'
|
||||
assert i['Dream Machine Pro']['kind'] == 'router'
|
||||
assert i['24RJ45-POE']['kind'] == 'switch'
|
||||
assert i['AP']['kind'] == 'ap'
|
||||
assert i['att-modem']['kind'] == 'modem'
|
||||
|
||||
def test_pdu_model_beats_reported_type(self):
|
||||
assert index()['RPDU']['kind'] == 'pdu'
|
||||
|
||||
|
||||
class TestSearchText:
|
||||
def test_finds_host_by_ip_and_interface(self):
|
||||
s = index()['large1']['search']
|
||||
assert '10.0.0.2' in s and 'eth1' in s
|
||||
|
||||
def test_mac_with_and_without_separators(self):
|
||||
s = index()['Dream Machine Pro']['search']
|
||||
assert 'aa:bb:cc:dd:ee:ff' in s and 'aabbccddeeff' in s
|
||||
|
||||
def test_switch_found_by_port_neighbor(self):
|
||||
assert 'large1' in index()['24RJ45-POE']['search']
|
||||
|
||||
def test_modem_found_by_either_address_or_word(self):
|
||||
s = index()['att-modem']['search']
|
||||
assert '192.168.1.254' in s and '203.0.113.5' in s and 'fiber' in s
|
||||
|
||||
|
||||
class TestStatus:
|
||||
def test_offline_unifi_device_is_down(self):
|
||||
assert index()['24RJ45-POE']['status'] == 'down'
|
||||
|
||||
def test_modem_status(self):
|
||||
def status(**kw):
|
||||
return {d['name']: d for d in devices.build_index({}, {}, dict(MODEM, **kw))}['att-modem']['status']
|
||||
assert status() == 'up'
|
||||
assert status(wan_problems=['optical WAN is Down']) == 'down'
|
||||
assert status(reachable=False) == 'unknown'
|
||||
|
||||
|
||||
class TestPartialData:
|
||||
def test_empty_state(self):
|
||||
assert devices.build_index({}, {}, {}) == []
|
||||
assert devices.build_index(None, None, None) == []
|
||||
|
||||
def test_switch_known_only_from_link_stats(self):
|
||||
d = {x['name']: x for x in devices.build_index({}, LINKS, None)}['24RJ45-POE']
|
||||
assert d['status'] == 'unknown' and d['kind'] == 'switch'
|
||||
|
||||
|
||||
class TestUnconfiguredHosts:
|
||||
LINKS = {'hosts': {'10.0.0.77': {'eth0': {'host_ip': '10.0.0.77', 'speed_mbps': 1000}}}}
|
||||
|
||||
def test_host_only_in_link_stats_is_kept(self):
|
||||
d = {x['name']: x for x in devices.build_index({}, self.LINKS, None)}['10.0.0.77']
|
||||
assert d['kind'] == 'host' and d['status'] == 'unknown' and d['ip'] == '10.0.0.77'
|
||||
|
||||
def test_its_interfaces_are_available(self):
|
||||
d = devices.device_detail('10.0.0.77', {}, self.LINKS, None)
|
||||
assert d['interfaces']['eth0']['speed_mbps'] == 1000
|
||||
|
||||
|
||||
class TestDetail:
|
||||
def test_unknown_device(self):
|
||||
assert devices.device_detail('nope', SNAPSHOT, LINKS, MODEM) is None
|
||||
|
||||
def test_host_merges_state_and_stats(self):
|
||||
d = devices.device_detail('large1', SNAPSHOT, LINKS, MODEM)
|
||||
assert d['interfaces']['eth0'] == {'state': 'up', 'host_ip': '10.0.0.2', 'speed_mbps': 1000}
|
||||
assert d['interfaces']['eth1'] == {'state': 'down'}
|
||||
assert 'search' not in d
|
||||
|
||||
def test_host_shows_switch_port_from_lldp(self):
|
||||
up = devices.device_detail('large1', SNAPSHOT, LINKS, MODEM)['uplinks']
|
||||
assert up == [{'switch': '24RJ45-POE', 'port': 'Port 3', 'port_idx': 3,
|
||||
'host_interface': 'eth0', 'up': True, 'speed_mbps': 1000}]
|
||||
|
||||
def test_switch_has_ports(self):
|
||||
assert set(devices.device_detail('24RJ45-POE', SNAPSHOT, LINKS, MODEM)['ports']) == {'Port 3', 'Port 4'}
|
||||
|
||||
def test_switch_gets_only_its_lldp_neighbors_for_the_path_check(self):
|
||||
links = dict(LINKS, hosts=dict(LINKS['hosts'], other={'eth9': {}}))
|
||||
d = devices.device_detail('24RJ45-POE', SNAPSHOT, links, MODEM)
|
||||
assert set(d['neighbor_hosts']) == {'large1'}
|
||||
assert 'eth0' in d['neighbor_hosts']['large1']
|
||||
|
||||
def test_router_has_info_even_without_port_data(self):
|
||||
d = devices.device_detail('Dream Machine Pro', SNAPSHOT, LINKS, MODEM)
|
||||
assert d['info']['firmware'] == '6.0.17' and d['ports'] == {}
|
||||
|
||||
|
||||
class TestLldpResolution:
|
||||
HOSTS = {'9c:6b:00:8a:17:e6': ('micro1', 'enp1s0')}
|
||||
DEVS = {'78:45:58:b1:bd:3a': '24RJ45-POE'}
|
||||
IPS = {'10.0.0.9': 'storage-01'}
|
||||
|
||||
def resolve(self, **lldp):
|
||||
sw = {'s': {'ports': {'p': {'lldp': lldp}}}}
|
||||
devices.resolve_lldp_neighbors(sw, self.HOSTS, self.DEVS, self.IPS)
|
||||
return sw['s']['ports']['p']['lldp']
|
||||
|
||||
def test_port_mac_gives_host_and_interface(self):
|
||||
got = self.resolve(chassis_id='aa:aa:aa:aa:aa:aa', port_id='9C:6B:00:8A:17:E6')
|
||||
assert (got['system_name'], got['port_id']) == ('micro1', 'enp1s0')
|
||||
|
||||
def test_chassis_mac_keeps_a_named_port(self):
|
||||
got = self.resolve(chassis_id='9c:6b:00:8a:17:e6', port_id='enp9s0')
|
||||
assert (got['system_name'], got['port_id']) == ('micro1', 'enp9s0')
|
||||
|
||||
def test_unifi_device_by_chassis(self):
|
||||
got = self.resolve(chassis_id='78:45:58:b1:bd:3a', port_id='Port 26')
|
||||
assert (got['system_name'], got['port_id']) == ('24RJ45-POE', 'Port 26')
|
||||
|
||||
def test_management_ip_fallback(self):
|
||||
got = self.resolve(chassis_id='aa:aa:aa:aa:aa:aa', port_id='x', mgmt_ips=['10.0.0.9'])
|
||||
assert got['system_name'] == 'storage-01'
|
||||
|
||||
def test_unknown_neighbor_stays_unnamed(self):
|
||||
got = self.resolve(chassis_id='aa:aa:aa:aa:aa:aa', port_id='aa:aa:aa:aa:aa:ab')
|
||||
assert got['system_name'] == ''
|
||||
|
||||
def test_a_reported_name_is_kept(self):
|
||||
got = self.resolve(system_name='lldp-name', chassis_id='78:45:58:b1:bd:3a', port_id='x')
|
||||
assert got['system_name'] == 'lldp-name'
|
||||
|
||||
def test_port_without_lldp_is_left_alone(self):
|
||||
sw = {'s': {'ports': {'p': {'lldp': None}}}}
|
||||
devices.resolve_lldp_neighbors(sw, self.HOSTS, self.DEVS, self.IPS)
|
||||
assert sw['s']['ports']['p']['lldp'] is None
|
||||
|
||||
|
||||
class TestClientLocations:
|
||||
HOSTS = {'aa:aa:aa:aa:aa:01': ('large1', 'enp35s0')}
|
||||
DEVS = {'bb:bb:bb:bb:bb:01': 'sw'}
|
||||
|
||||
def apply(self, port, sw_port=10):
|
||||
switches = {'sw': {'ports': {'Port 10': dict({'port_idx': 10}, **port)}}}
|
||||
client = {'mac': 'AA:AA:AA:AA:AA:01', 'sw_mac': 'bb:bb:bb:bb:bb:01', 'sw_port': sw_port}
|
||||
devices.apply_client_locations(switches, [client], self.HOSTS, self.DEVS)
|
||||
return switches['sw']['ports']['Port 10']['lldp']
|
||||
|
||||
def test_server_without_lldp_is_located(self):
|
||||
got = self.apply({'lldp': None})
|
||||
assert (got['system_name'], got['port_id'], got['source']) == ('large1', 'enp35s0', 'unifi-clients')
|
||||
|
||||
def test_uplink_port_is_skipped(self):
|
||||
assert self.apply({'lldp': None, 'is_uplink': True}) is None
|
||||
|
||||
def test_named_lldp_neighbor_is_kept(self):
|
||||
assert self.apply({'lldp': {'system_name': 'other'}})['system_name'] == 'other'
|
||||
|
||||
def test_unnamed_lldp_entry_is_replaced(self):
|
||||
assert self.apply({'lldp': {'system_name': '', 'chassis_id': 'x'}})['system_name'] == 'large1'
|
||||
|
||||
def test_other_port_is_untouched(self):
|
||||
assert self.apply({'lldp': None}, sw_port=11) is None
|
||||
|
||||
def test_non_host_client_is_ignored(self):
|
||||
switches = {'sw': {'ports': {'Port 10': {'port_idx': 10, 'lldp': None}}}}
|
||||
devices.apply_client_locations(
|
||||
switches, [{'mac': 'cc:cc:cc:cc:cc:cc', 'sw_mac': 'bb:bb:bb:bb:bb:01', 'sw_port': 10}],
|
||||
self.HOSTS, self.DEVS,
|
||||
)
|
||||
assert switches['sw']['ports']['Port 10']['lldp'] is None
|
||||
@@ -473,12 +473,27 @@ class TestAnalyze:
|
||||
assert 'LLDP_MISSING' in codes
|
||||
|
||||
def test_lldp_mismatch_is_warning(self):
|
||||
# The server's lldpd sees a different switch than the one this port belongs to.
|
||||
sections = self._sections(lldpctl={'available': True, 'neighbor_system': 'wrong-switch'})
|
||||
switch_data = {'speed_mbps': 1000, 'lldp': {'system_name': 'core-sw-01'}}
|
||||
switch_data = {'speed_mbps': 1000, 'switch_name': 'core-sw-01', 'lldp': {'system_name': 'server-a'}}
|
||||
result = DiagnosticsRunner.analyze(sections, switch_data)
|
||||
codes = [w['code'] for w in result['warnings']]
|
||||
assert 'LLDP_MISMATCH' in codes
|
||||
|
||||
def test_lldp_match_is_not_a_warning(self):
|
||||
# Correct cabling: the switch sees the server, the server sees the switch.
|
||||
sections = self._sections(lldpctl={'available': True, 'neighbor_system': 'core-sw-01'})
|
||||
switch_data = {'speed_mbps': 1000, 'switch_name': 'core-sw-01', 'lldp': {'system_name': 'server-a'}}
|
||||
result = DiagnosticsRunner.analyze(sections, switch_data)
|
||||
codes = [w['code'] for w in result['warnings']]
|
||||
assert 'LLDP_MISMATCH' not in codes
|
||||
|
||||
def test_lldp_without_switch_name_skips_check(self):
|
||||
sections = self._sections(lldpctl={'available': True, 'neighbor_system': 'anything'})
|
||||
result = DiagnosticsRunner.analyze(sections, {'speed_mbps': 1000, 'lldp': {'system_name': 'server-a'}})
|
||||
codes = [w['code'] for w in result['warnings']]
|
||||
assert 'LLDP_MISMATCH' not in codes
|
||||
|
||||
def test_healthy_link_no_issues(self):
|
||||
result = DiagnosticsRunner.analyze(self._sections(), {})
|
||||
assert result['issues'] == []
|
||||
|
||||
@@ -0,0 +1,257 @@
|
||||
"""Tests for modem.py parsing. Fixtures copy the BGW320-505 (fw 6.35.8) markup with sanitized values."""
|
||||
import os
|
||||
import sys
|
||||
from unittest.mock import MagicMock
|
||||
|
||||
import pytest
|
||||
import requests
|
||||
|
||||
sys.path.insert(0, os.path.dirname(os.path.dirname(__file__)))
|
||||
|
||||
import modem # noqa: E402
|
||||
|
||||
|
||||
def dom_table(heading, current, flags=(0, 0, 0, 0), limits=(-292, -90, -279, -100)):
|
||||
return f'''
|
||||
<h1>{heading} Currently {current}</h1>
|
||||
<table class="grid table100" summary="{heading} table">
|
||||
<thead><tr><th scope="col" width="30%"> </th><th scope="col">Low</th><th scope="col">High</th></tr></thead>
|
||||
<tbody>
|
||||
<tr class="a"><td class="heading" scope="row">Alarm</td>
|
||||
<td>{flags[0]} (Threshold {limits[0]})</td>
|
||||
<td>{flags[1]} (Threshold {limits[1]})</td>
|
||||
</tr>
|
||||
<tr class="b"><td class="heading" scope="row">Warning</td>
|
||||
<td>{flags[2]} (Threshold {limits[2]})</td>
|
||||
<td>{flags[3]} (Threshold {limits[3]})</td>
|
||||
</tr>
|
||||
</tbody></table>'''
|
||||
|
||||
|
||||
def fiber_page(optical='Up', rx=-169, rx_flags=(0, 0, 0, 0), include_rx=True):
|
||||
rx_table = dom_table('Rx Power', rx, rx_flags) if include_rx else ''
|
||||
return f'''<html><title>Fiber Status</title>
|
||||
<tr><th scope="row" width="47%">Optical WAN Operational Status</th>
|
||||
<td class="col2">{optical} </td></tr>
|
||||
<tr><th scope="row">Wave Length</th><td class="col2">1270 nm </td></tr>
|
||||
<tr><th scope="row">Rx LOS State</th><td class="col2">1</td></tr>
|
||||
<tr><th scope="row">Vendor PN</th><td class="col2">TESTPN</td></tr>
|
||||
{dom_table('Temperature', 34, limits=(-50, 95, -45, 90))}
|
||||
{dom_table('Vcc', 3, limits=(3, 3, 3, 3))}
|
||||
{dom_table('Tx Bias', 6, limits=(0, 500, 0, 400))}
|
||||
{dom_table('Tx Power', 33, limits=(-10, 59, 0, 49))}
|
||||
{rx_table}</html>'''
|
||||
|
||||
|
||||
def broadband_page(connection='Up', pon='OPERATION (O5)'):
|
||||
return f'''<html><title>Broadband Status</title>
|
||||
<tr><th scope="row" width="47%">Broadband Connection Source</th><td class="col2">FIBER</td></tr>
|
||||
<tr><th scope="row" width="47%">Broadband Connection</th>
|
||||
<td class="col2">
|
||||
{connection}
|
||||
</td></tr>
|
||||
<tr><th scope="row">Broadband IPv4 Address</th><td class="col2">203.0.113.10</td></tr>
|
||||
<tr class="a"><th scope="row" class="heading a">Current Speed (Mbps)</th><td>10000</td></tr>
|
||||
<tr><th scope="row">Transmit Bytes</th><td>200</td></tr>
|
||||
<tr><th scope="row">Receive Bytes</th><td>100</td></tr>
|
||||
<tr><th scope="row">Receive Errors</th><td>1</td></tr>
|
||||
<tr><th scope="row">Transmit Errors</th><td>2</td></tr>
|
||||
<tr><th scope="row">Receive Drops</th><td>3</td></tr>
|
||||
<tr><th scope="row">Transmit Drops</th><td>4</td></tr>
|
||||
<tr><th scope="row">Transmit Packets</th><td>7</td></tr>
|
||||
<tr><th scope="row">Transmit Packets</th><td>999</td></tr>
|
||||
<tr><th scope="row">PON Link Status</th><td>{pon}</td></tr>
|
||||
<tr><th scope="row">UNI Status</th><td>up</td></tr></html>'''
|
||||
|
||||
|
||||
SYSINFO = '''<tr><th scope="row">Model Number</th><td class="col2">BGW320-505</td></tr>
|
||||
<tr><th scope="row">Software Version</th><td class="col2">6.35.8</td></tr>
|
||||
<tr><th scope="row">Time Since Last Reboot</th><td class="col2">28951</td></tr>'''
|
||||
|
||||
|
||||
class TestBuildStatus:
|
||||
def test_scales_optical_power_from_tenths_of_dbm(self):
|
||||
d = modem.build_status(fiber_page(), broadband_page(), SYSINFO)
|
||||
assert d['optics']['rx_power']['value'] == -16.9
|
||||
assert d['optics']['tx_power']['value'] == 3.3
|
||||
assert d['optics']['temperature']['value'] == 34.0
|
||||
|
||||
def test_scales_thresholds(self):
|
||||
rx = modem.build_status(fiber_page(), broadband_page())['optics']['rx_power']
|
||||
assert (rx['alarm_low'], rx['alarm_high'], rx['warn_low'], rx['warn_high']) == (-29.2, -9.0, -27.9, -10.0)
|
||||
|
||||
def test_unit_ambiguous_readings_are_dropped_but_flags_kept(self):
|
||||
d = modem.build_status(fiber_page(), broadband_page())
|
||||
assert d['optics']['tx_bias']['value'] is None
|
||||
assert d['optics']['vcc']['alarm_low'] is None
|
||||
assert d['optics']['vcc']['alarm_flag'] is False
|
||||
|
||||
def test_system_and_wan_fields(self):
|
||||
d = modem.build_status(fiber_page(), broadband_page(), SYSINFO)
|
||||
assert d['model'] == 'BGW320-505'
|
||||
assert d['firmware'] == '6.35.8'
|
||||
assert d['uptime_s'] == 28951
|
||||
assert d['broadband_state'] == 'Up'
|
||||
assert d['line_speed_mbps'] == 10000
|
||||
assert d['counters'] == {
|
||||
'rx_bytes': 100, 'tx_bytes': 200, 'rx_errors': 1,
|
||||
'tx_errors': 2, 'rx_drops': 3, 'tx_drops': 4,
|
||||
}
|
||||
|
||||
def test_repeated_label_keeps_first_value(self):
|
||||
assert modem.parse_rows(broadband_page())['Transmit Packets'] == '7'
|
||||
|
||||
def test_sysinfo_is_optional(self):
|
||||
d = modem.build_status(fiber_page(), broadband_page(), '')
|
||||
assert d['model'] == '' and d['uptime_s'] is None
|
||||
|
||||
def test_unknown_page_is_invalid(self):
|
||||
with pytest.raises(modem.ModemDataInvalid):
|
||||
modem.build_status('<html>nope</html>', broadband_page())
|
||||
with pytest.raises(modem.ModemDataInvalid):
|
||||
modem.build_status(fiber_page(), '<html>nope</html>')
|
||||
|
||||
def test_up_link_without_rx_power_is_invalid(self):
|
||||
with pytest.raises(modem.ModemDataInvalid):
|
||||
modem.build_status(fiber_page(include_rx=False), broadband_page())
|
||||
|
||||
def test_cut_fiber_without_rx_power_is_not_invalid(self):
|
||||
d = modem.build_status(fiber_page(optical='Down', include_rx=False), broadband_page(connection='Down'))
|
||||
assert 'rx_power' not in d['optics']
|
||||
assert modem.wan_problems(d)
|
||||
|
||||
|
||||
class TestWanProblems:
|
||||
def test_healthy_link_has_none(self):
|
||||
assert modem.wan_problems(modem.build_status(fiber_page(), broadband_page())) == []
|
||||
|
||||
@pytest.mark.parametrize('field,value,expected', [
|
||||
('broadband_state', 'Down', 'broadband connection is Down'),
|
||||
('optical_state', 'Down', 'optical WAN is Down'),
|
||||
('pon_state', 'INITIAL (O1)', 'PON link state is INITIAL (O1)'),
|
||||
])
|
||||
def test_each_failure_is_reported(self, field, value, expected):
|
||||
d = {'broadband_state': 'Up', 'optical_state': 'Up', 'pon_state': 'OPERATION (O5)', field: value}
|
||||
assert modem.wan_problems(d) == [expected]
|
||||
|
||||
def test_missing_pon_field_is_not_a_problem(self):
|
||||
assert modem.wan_problems({'broadband_state': 'Up', 'optical_state': 'Up', 'pon_state': ''}) == []
|
||||
|
||||
def test_rx_los_pin_is_ignored(self):
|
||||
# Real gateways report Rx LOS State=1 on a healthy link (see fixture).
|
||||
assert modem.wan_problems(modem.build_status(fiber_page(), broadband_page())) == []
|
||||
|
||||
|
||||
class TestMetricStatus:
|
||||
@pytest.mark.parametrize('rx,expected', [
|
||||
(-169, 'ok'),
|
||||
(-279, 'warning'),
|
||||
(-285, 'warning'),
|
||||
(-292, 'alarm'),
|
||||
(-400, 'alarm'),
|
||||
(-100, 'warning'),
|
||||
(-90, 'alarm'),
|
||||
])
|
||||
def test_rx_thresholds(self, rx, expected):
|
||||
rx_metric = modem.parse_dom_metrics(fiber_page(rx=rx))['rx_power']
|
||||
assert modem.metric_status(rx_metric) == expected
|
||||
|
||||
def test_module_flags_win_over_reading(self):
|
||||
alarm = modem.parse_dom_metrics(fiber_page(rx_flags=(1, 0, 0, 0)))['rx_power']
|
||||
warn = modem.parse_dom_metrics(fiber_page(rx_flags=(0, 0, 1, 0)))['rx_power']
|
||||
assert modem.metric_status(alarm) == 'alarm'
|
||||
assert modem.metric_status(warn) == 'warning'
|
||||
|
||||
def test_flag_only_metric(self):
|
||||
assert modem.metric_status(modem.parse_dom_metrics(fiber_page())['vcc']) == 'ok'
|
||||
|
||||
|
||||
class TestCounterRates:
|
||||
def test_rate_from_delta(self):
|
||||
assert modem.counter_rates({'rx_bytes': 300}, {'rx_bytes': 100}, 100)['rx_bytes'] == 2.0
|
||||
|
||||
def test_first_poll_is_none(self):
|
||||
assert modem.counter_rates({'rx_bytes': 300}, None, 100)['rx_bytes'] is None
|
||||
|
||||
def test_reboot_counter_reset_is_none(self):
|
||||
assert modem.counter_rates({'rx_bytes': 5}, {'rx_bytes': 100}, 100)['rx_bytes'] is None
|
||||
|
||||
|
||||
class TestClient:
|
||||
def _client(self, **response):
|
||||
c = modem.ModemClient({'url': 'http://modem.test/'})
|
||||
resp = MagicMock(status_code=response.get('status', 200), text=response.get('text', ''))
|
||||
c.session.get = MagicMock(return_value=resp)
|
||||
return c
|
||||
|
||||
def test_network_failure_is_unreachable(self):
|
||||
c = self._client()
|
||||
c.session.get = MagicMock(side_effect=requests.ConnectionError('boom'))
|
||||
with pytest.raises(modem.ModemUnreachable):
|
||||
c.poll()
|
||||
|
||||
def test_redirect_is_invalid_and_not_followed(self):
|
||||
c = self._client(status=302)
|
||||
with pytest.raises(modem.ModemDataInvalid):
|
||||
c.poll()
|
||||
assert c.session.get.call_args.kwargs['allow_redirects'] is False
|
||||
|
||||
def test_login_page_is_invalid(self):
|
||||
with pytest.raises(modem.ModemDataInvalid, match='login'):
|
||||
self._client(text='<html><title>Login</title></html>').poll()
|
||||
|
||||
|
||||
class TestWanHistory:
|
||||
def ev(self, key, ts, device='RPDU'):
|
||||
return {'key': key, 'ts': ts, 'device': device, 'wan': 'WAN1'}
|
||||
|
||||
def test_outage_opens_and_closes(self):
|
||||
h = {}
|
||||
modem.apply_wan_events(h, [self.ev(modem.LOG_WAN_FAILED, 100), self.ev(modem.LOG_WAN_RESTORED, 200)])
|
||||
assert h['outages'] == [{'failed_at': 100, 'restored_at': 200, 'wan': 'WAN1'}]
|
||||
|
||||
def test_events_are_handled_in_time_order(self):
|
||||
h = {}
|
||||
modem.apply_wan_events(h, [self.ev(modem.LOG_WAN_RESTORED, 200), self.ev(modem.LOG_WAN_FAILED, 100)])
|
||||
assert h['outages'][0]['restored_at'] == 200
|
||||
|
||||
def test_outage_spanning_two_batches(self):
|
||||
h = {}
|
||||
modem.apply_wan_events(h, [self.ev(modem.LOG_WAN_FAILED, 100)])
|
||||
assert h['outages'][0]['restored_at'] is None
|
||||
modem.apply_wan_events(h, [self.ev(modem.LOG_WAN_RESTORED, 200)])
|
||||
assert h['outages'][0]['restored_at'] == 200
|
||||
|
||||
def test_repeat_failure_does_not_open_a_second_outage(self):
|
||||
h = {}
|
||||
modem.apply_wan_events(h, [self.ev(modem.LOG_WAN_FAILED, 100), self.ev(modem.LOG_WAN_FAILED, 150)])
|
||||
assert len(h['outages']) == 1
|
||||
|
||||
def test_restored_without_failure_is_ignored(self):
|
||||
h = {}
|
||||
modem.apply_wan_events(h, [self.ev(modem.LOG_WAN_RESTORED, 200)])
|
||||
assert h['outages'] == []
|
||||
|
||||
def test_blip_is_not_actionable_but_restart_and_instability_are(self):
|
||||
keys = [modem.LOG_WAN_FAILED, modem.LOG_WAN_RESTORED, modem.LOG_MODEM_RESTARTED, modem.LOG_WAN_UNSTABLE]
|
||||
got = modem.apply_wan_events({}, [self.ev(k, i) for i, k in enumerate(keys)])
|
||||
assert [e['key'] for e in got] == [modem.LOG_MODEM_RESTARTED, modem.LOG_WAN_UNSTABLE]
|
||||
|
||||
def test_history_is_bounded(self):
|
||||
h = {}
|
||||
for i in range(60):
|
||||
modem.apply_wan_events(h, [
|
||||
self.ev(modem.LOG_WAN_FAILED, i * 2), self.ev(modem.LOG_WAN_RESTORED, i * 2 + 1),
|
||||
])
|
||||
assert len(h['outages']) == 50
|
||||
|
||||
def test_uptime_reset_confirms_logged_restart(self):
|
||||
h = {}
|
||||
modem.apply_wan_events(h, [self.ev(modem.LOG_MODEM_RESTARTED, 1000)])
|
||||
modem.record_uptime_reset(h, 1023)
|
||||
assert h['restarts'] == [{'at': 1000, 'by': 'RPDU', 'confirmed': True}]
|
||||
|
||||
def test_unexplained_uptime_reset_is_recorded(self):
|
||||
h = {}
|
||||
modem.record_uptime_reset(h, 5000)
|
||||
assert h['restarts'] == [{'at': 5000, 'by': None, 'confirmed': True}]
|
||||
@@ -0,0 +1,439 @@
|
||||
"""Tests for monitor.py alert logic: database and external services are mocked."""
|
||||
import json
|
||||
import os
|
||||
import sys
|
||||
import time
|
||||
from unittest.mock import MagicMock, patch
|
||||
|
||||
import pytest
|
||||
|
||||
sys.path.insert(0, os.path.dirname(os.path.dirname(__file__)))
|
||||
|
||||
import modem as modem_api # noqa: E402
|
||||
import monitor # noqa: E402
|
||||
|
||||
HOST_A, HOST_B = '10.0.0.1:9100', '10.0.0.2:9100'
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def db():
|
||||
with patch.object(monitor, 'db') as mock_db:
|
||||
mock_db.check_suppressed.return_value = False
|
||||
mock_db.get_baseline.return_value = {}
|
||||
# Second consecutive failure and no ticket yet, unless a test overrides it
|
||||
mock_db.upsert_event.return_value = (1, False, 2, None)
|
||||
mock_db.get_modem_rx_values.return_value = []
|
||||
mock_db.get_state.return_value = None
|
||||
yield mock_db
|
||||
|
||||
|
||||
@pytest.fixture
|
||||
def mon(db):
|
||||
m = monitor.NetworkMonitor.__new__(monitor.NetworkMonitor)
|
||||
m.cfg = {}
|
||||
m.fail_thresh = 2
|
||||
m.host_fail_thresh = 5
|
||||
m.cluster_thresh = 2
|
||||
m.cluster_name = 'test-cluster'
|
||||
m.tickets = MagicMock()
|
||||
m.tickets.create.return_value = '123'
|
||||
m.prom = MagicMock(url='http://prom.test')
|
||||
m._instance_map = {HOST_A: 'alpha', HOST_B: 'beta'}
|
||||
m._last_iface_states = {}
|
||||
m.modem = MagicMock(base_url='http://modem.test')
|
||||
m.modem_name = 'att-modem'
|
||||
m.modem_lan_ip = '192.168.1.254'
|
||||
m.modem_fail_thresh = 2
|
||||
m.rx_drift_db = 3.0
|
||||
m.rx_drift_min_samples = 288
|
||||
m._prev_modem_counters = None
|
||||
m._prev_modem_time = 0.0
|
||||
return m
|
||||
|
||||
|
||||
def upserted(db):
|
||||
return [(c.args[0], c.args[3], c.args[4]) for c in db.upsert_event.call_args_list]
|
||||
|
||||
|
||||
def healthy_modem(rx=-16.9, rx_status=None):
|
||||
def metric(value, alarm_low, alarm_high, warn_low, warn_high):
|
||||
return {'value': value, 'alarm_low': alarm_low, 'alarm_high': alarm_high,
|
||||
'warn_low': warn_low, 'warn_high': warn_high,
|
||||
'alarm_flag': False, 'warn_flag': False}
|
||||
return {
|
||||
'broadband_state': 'Up', 'optical_state': 'Up', 'pon_state': 'OPERATION (O5)',
|
||||
'counters': {'rx_bytes': 1},
|
||||
'optics': {
|
||||
'rx_power': metric(rx, -29.2, -9.0, -27.9, -10.0),
|
||||
'tx_power': metric(3.3, -1.0, 5.9, 0.0, 4.9),
|
||||
'temperature': metric(34.0, -50.0, 95.0, -45.0, 90.0),
|
||||
},
|
||||
}
|
||||
|
||||
|
||||
class TestDeadHostDetection:
|
||||
def test_host_missing_from_prometheus_alerts_and_tickets(self, mon, db):
|
||||
db.upsert_event.return_value = (1, False, 5, None)
|
||||
mon._process_interfaces({HOST_A: {'eth0': True}}, [])
|
||||
assert ('host_metrics_missing', 'beta', HOST_B) in upserted(db)
|
||||
assert 'No metrics' in mon.tickets.create.call_args.args[0]
|
||||
|
||||
def test_host_reporting_resolves_the_event(self, mon, db):
|
||||
mon._process_interfaces({HOST_A: {'eth0': True}, HOST_B: {'eth0': True}}, [])
|
||||
db.resolve_event.assert_any_call('host_metrics_missing', 'beta', HOST_B)
|
||||
assert not db.upsert_event.called
|
||||
|
||||
def test_no_ticket_before_threshold(self, mon, db):
|
||||
db.upsert_event.return_value = (1, True, 1, None)
|
||||
mon._process_interfaces({HOST_A: {'eth0': True}}, [])
|
||||
assert not mon.tickets.create.called
|
||||
|
||||
def test_reboot_length_outage_is_recorded_without_a_ticket(self, mon, db):
|
||||
db.upsert_event.return_value = (1, False, 4, None)
|
||||
mon._process_interfaces({HOST_A: {'eth0': True}}, [])
|
||||
assert ('host_metrics_missing', 'beta', HOST_B) in upserted(db)
|
||||
assert not mon.tickets.create.called
|
||||
|
||||
def test_interface_down_keeps_the_shorter_threshold(self, mon, db):
|
||||
db.get_baseline.return_value = {'alpha': {'eth0': 'up'}, 'beta': {'eth0': 'up'}}
|
||||
mon._process_interfaces({HOST_A: {'eth0': False}, HOST_B: {'eth0': True}}, [])
|
||||
assert 'Interface eth0 link-down' in mon.tickets.create.call_args.args[0]
|
||||
|
||||
def test_suppressed_host_gets_no_ticket(self, mon, db):
|
||||
db.upsert_event.return_value = (1, False, 5, None)
|
||||
db.check_suppressed.return_value = True
|
||||
mon._process_interfaces({HOST_A: {'eth0': True}}, [])
|
||||
assert not mon.tickets.create.called
|
||||
|
||||
def test_missing_hosts_count_toward_cluster_alert(self, mon, db):
|
||||
mon._instance_map['10.0.0.3:9100'] = 'gamma'
|
||||
mon._process_interfaces({HOST_A: {'eth0': True}}, [])
|
||||
assert ('cluster_network_issue', 'test-cluster', '') in upserted(db)
|
||||
|
||||
def test_dead_host_shows_as_down_on_dashboard(self, mon):
|
||||
snap = mon._collect_snapshot({HOST_A: {'eth0': True}})
|
||||
assert snap['hosts']['alpha']['status'] == 'up'
|
||||
assert snap['hosts']['beta']['status'] == 'down'
|
||||
|
||||
|
||||
class TestPrometheusOutage:
|
||||
def test_empty_result_means_unavailable(self):
|
||||
client = monitor.PrometheusClient('http://prom.test')
|
||||
with patch.object(client, '_fetch', return_value=[]):
|
||||
assert client.get_interface_states() is None
|
||||
|
||||
def test_failed_query_is_unavailable_not_empty(self):
|
||||
client = monitor.PrometheusClient('http://prom.test')
|
||||
with patch.object(monitor.requests, 'get', side_effect=OSError('boom')):
|
||||
assert client.get_interface_states() is None
|
||||
assert client.query('up') == []
|
||||
|
||||
def test_outage_alerts_about_prometheus_not_each_host(self, mon, db):
|
||||
mon._process_prometheus_outage([])
|
||||
assert upserted(db) == [('monitor_source_unavailable', 'prometheus', '')]
|
||||
|
||||
def test_dashboard_keeps_hosts_as_unknown(self, mon):
|
||||
mon._last_iface_states = {HOST_A: {'eth0': True}}
|
||||
snap = mon._collect_snapshot(None)
|
||||
assert snap['hosts']['alpha']['status'] == 'unknown'
|
||||
assert snap['hosts']['alpha']['interfaces'] == {'eth0': 'up'}
|
||||
assert snap['hosts']['beta']['status'] == 'unknown'
|
||||
|
||||
|
||||
class TestPingUnknown:
|
||||
def _pulse(self, output):
|
||||
pulse = monitor.PulseClient({})
|
||||
pulse.run_command = MagicMock(return_value=output)
|
||||
return pulse
|
||||
|
||||
def test_pulse_failure_is_unknown(self):
|
||||
assert self._pulse(None).ping('10.0.0.1') is None
|
||||
|
||||
def test_reachability(self):
|
||||
assert self._pulse('REACHABLE\n').ping('10.0.0.1') is True
|
||||
assert self._pulse('UNREACHABLE\n').ping('10.0.0.1') is False
|
||||
|
||||
def test_unknown_neither_alerts_nor_resolves(self, mon, db):
|
||||
mon.cfg = {'monitor': {'ping_hosts': [{'name': 'pbs', 'ip': '10.0.0.3'}]}}
|
||||
mon._process_ping_hosts([], {'pbs': None})
|
||||
assert not db.upsert_event.called
|
||||
assert not db.resolve_event.called
|
||||
|
||||
def test_unreachable_still_alerts(self, mon, db):
|
||||
mon.cfg = {'monitor': {'ping_hosts': [{'name': 'pbs', 'ip': '10.0.0.3'}]}}
|
||||
mon._process_ping_hosts([], {'pbs': False})
|
||||
assert ('host_unreachable', 'pbs', '10.0.0.3') in upserted(db)
|
||||
|
||||
def test_ping_host_ticket_waits_out_a_reboot(self, mon, db):
|
||||
mon.cfg = {'monitor': {'ping_hosts': [{'name': 'pbs', 'ip': '10.0.0.3'}]}}
|
||||
db.upsert_event.return_value = (1, False, 4, None)
|
||||
mon._process_ping_hosts([], {'pbs': False})
|
||||
assert not mon.tickets.create.called
|
||||
db.upsert_event.return_value = (1, False, 5, None)
|
||||
mon._process_ping_hosts([], {'pbs': False})
|
||||
assert 'Host unreachable' in mon.tickets.create.call_args.args[0]
|
||||
|
||||
|
||||
class TestUnifiRates:
|
||||
def _collector(self):
|
||||
c = monitor.LinkStatsCollector.__new__(monitor.LinkStatsCollector)
|
||||
c._prev_unifi_time = 100.0
|
||||
c._prev_unifi = {'sw': {'ports': {'Port 1': {
|
||||
'tx_bytes': 100, 'rx_bytes': 100, 'tx_errors': 0, 'rx_errors': 0, 'tx_dropped': 0, 'rx_dropped': 0,
|
||||
}}}}
|
||||
return c
|
||||
|
||||
def test_new_port_has_no_rate_spike(self):
|
||||
port = {'tx_bytes': 10**12, 'rx_bytes': 10**12, 'tx_errors': 5, 'rx_errors': 5,
|
||||
'tx_dropped': 5, 'rx_dropped': 5}
|
||||
raw = {'sw': {'ip': '', 'model': '', 'ports': {'Port 1': dict(port, tx_bytes=300), 'Port 2': port}}}
|
||||
result = self._collector()._compute_unifi_rates(raw, 200.0)['sw']['ports']
|
||||
assert result['Port 2']['tx_bytes_rate'] is None
|
||||
assert result['Port 1']['tx_bytes_rate'] == 2.0
|
||||
|
||||
|
||||
class TestModemAlerts:
|
||||
def test_healthy_link_raises_nothing(self, mon, db):
|
||||
mon._process_modem(healthy_modem(), [])
|
||||
assert not db.upsert_event.called
|
||||
assert not mon.tickets.create.called
|
||||
|
||||
def test_wan_down_is_p1(self, mon, db):
|
||||
data = healthy_modem()
|
||||
data['broadband_state'] = 'Down'
|
||||
mon._process_modem(data, [])
|
||||
assert ('wan_down', 'att-modem', '') in upserted(db)
|
||||
assert mon.tickets.create.call_args.kwargs['priority'] == '1'
|
||||
|
||||
def test_cut_fiber_opens_only_one_ticket(self, mon, db):
|
||||
data = healthy_modem(rx=-40.0)
|
||||
data['optical_state'] = 'Down'
|
||||
mon._process_modem(data, [])
|
||||
assert [e[0] for e in upserted(db)] == ['wan_down']
|
||||
|
||||
def test_low_rx_warning(self, mon, db):
|
||||
mon._process_modem(healthy_modem(rx=-28.0), [])
|
||||
assert ('fiber_signal_warning', 'att-modem', 'rx_power') in upserted(db)
|
||||
assert mon.tickets.create.call_args.kwargs['priority'] == '3'
|
||||
db.resolve_event.assert_any_call('fiber_signal_alarm', 'att-modem', 'rx_power')
|
||||
|
||||
def test_low_rx_alarm_with_link_up(self, mon, db):
|
||||
mon._process_modem(healthy_modem(rx=-30.0), [])
|
||||
assert ('fiber_signal_alarm', 'att-modem', 'rx_power') in upserted(db)
|
||||
db.resolve_event.assert_any_call('fiber_signal_warning', 'att-modem', 'rx_power')
|
||||
|
||||
def test_recovery_resolves_signal_events(self, mon, db):
|
||||
mon._process_modem(healthy_modem(), [])
|
||||
db.resolve_event.assert_any_call('fiber_signal_alarm', 'att-modem', 'rx_power')
|
||||
db.resolve_event.assert_any_call('fiber_signal_warning', 'att-modem', 'rx_power')
|
||||
db.resolve_event.assert_any_call('wan_down', 'att-modem', '')
|
||||
|
||||
def test_suppression_blocks_ticket(self, mon, db):
|
||||
db.check_suppressed.return_value = True
|
||||
mon._process_modem(healthy_modem(rx=-30.0), [])
|
||||
assert upserted(db)
|
||||
assert not mon.tickets.create.called
|
||||
|
||||
def test_drift_needs_enough_history(self, mon, db):
|
||||
db.get_modem_rx_values.return_value = [-17.0] * 10
|
||||
mon._process_modem(healthy_modem(rx=-25.0), [])
|
||||
assert not any(e[0] == 'fiber_rx_drift' for e in upserted(db))
|
||||
|
||||
def test_drift_alerts_inside_the_modem_limits(self, mon, db):
|
||||
db.get_modem_rx_values.return_value = [-17.0] * 300
|
||||
mon._process_modem(healthy_modem(rx=-21.0), [])
|
||||
assert ('fiber_rx_drift', 'att-modem', 'rx_power') in upserted(db)
|
||||
assert 'fiber_signal_warning' not in [e[0] for e in upserted(db)]
|
||||
|
||||
def test_small_change_is_not_drift(self, mon, db):
|
||||
db.get_modem_rx_values.return_value = [-17.0] * 300
|
||||
mon._process_modem(healthy_modem(rx=-18.0), [])
|
||||
assert not db.upsert_event.called
|
||||
db.resolve_event.assert_any_call('fiber_rx_drift', 'att-modem', 'rx_power')
|
||||
|
||||
def test_stronger_signal_is_not_drift(self, mon, db):
|
||||
db.get_modem_rx_values.return_value = [-17.0] * 300
|
||||
mon._process_modem(healthy_modem(rx=-12.0), [])
|
||||
assert not db.upsert_event.called
|
||||
|
||||
|
||||
class TestModemCollection:
|
||||
def test_unreachable_keeps_link_events_open(self, mon, db):
|
||||
mon.modem.poll.side_effect = modem_api.ModemUnreachable('timeout')
|
||||
mon._collect_modem([])
|
||||
assert upserted(db) == [('modem_unreachable', 'att-modem', '')]
|
||||
assert db.set_state.call_args.args[1]['reachable'] is False
|
||||
assert not db.record_modem_sample.called
|
||||
resolved = [c.args[0] for c in db.resolve_event.call_args_list]
|
||||
assert 'wan_down' not in resolved and 'fiber_signal_alarm' not in resolved
|
||||
|
||||
def test_unreadable_page_is_a_warning_not_an_outage(self, mon, db):
|
||||
mon.modem.poll.side_effect = modem_api.ModemDataInvalid('login required')
|
||||
mon._collect_modem([])
|
||||
assert upserted(db) == [('modem_data_invalid', 'att-modem', '')]
|
||||
assert mon.tickets.create.call_args.kwargs['priority'] == '3'
|
||||
|
||||
def test_success_stores_status_and_sample(self, mon, db):
|
||||
mon.modem.poll.return_value = healthy_modem()
|
||||
mon._collect_modem([])
|
||||
assert db.set_state.call_args.args[0] == 'modem_stats'
|
||||
assert db.set_state.call_args.args[1]['reachable'] is True
|
||||
db.record_modem_sample.assert_called_once_with(-16.9, 3.3, 34.0)
|
||||
|
||||
def test_drift_baseline_excludes_the_current_reading(self, mon, db):
|
||||
order = []
|
||||
db.get_modem_rx_values.side_effect = lambda days: order.append('read') or []
|
||||
db.record_modem_sample.side_effect = lambda *a: order.append('write')
|
||||
mon.modem.poll.return_value = healthy_modem()
|
||||
mon._collect_modem([])
|
||||
assert order == ['read', 'write']
|
||||
|
||||
|
||||
class TestWanLog:
|
||||
def _mon(self, mon, events):
|
||||
mon.unifi = MagicMock()
|
||||
mon.unifi.get_system_events.return_value = events
|
||||
return mon
|
||||
|
||||
def _state(self, db, **values):
|
||||
db.get_state.side_effect = lambda key, default=None: values.get(key, default)
|
||||
|
||||
def test_first_run_starts_from_now_without_tickets(self, mon, db):
|
||||
self._state(db)
|
||||
self._mon(mon, [])._process_wan_log([])
|
||||
assert db.set_state.call_args.args[0] == 'unifi_log_cursor'
|
||||
assert not mon.unifi.get_system_events.called
|
||||
|
||||
def test_log_failure_keeps_the_cursor(self, mon, db):
|
||||
self._state(db, unifi_log_cursor='1000')
|
||||
self._mon(mon, None)._process_wan_log([])
|
||||
assert not db.set_state.called
|
||||
|
||||
def test_rpdu_restart_opens_a_ticket_and_resolves(self, mon, db):
|
||||
self._state(db, unifi_log_cursor=str(int(time.time() * 1000)))
|
||||
db.upsert_event.return_value = (9, True, 1, None)
|
||||
self._mon(mon, [{'key': modem_api.LOG_MODEM_RESTARTED, 'ts': time.time(), 'device': 'RPDU', 'wan': ''}])
|
||||
mon._process_wan_log([])
|
||||
assert 'power-cycled' in mon.tickets.create.call_args.args[0]
|
||||
db.resolve_event.assert_called_with('modem_power_cycled', 'att-modem', '')
|
||||
|
||||
def test_short_outage_only_records_history(self, mon, db):
|
||||
now = time.time()
|
||||
self._state(db, unifi_log_cursor=str(int(now * 1000)))
|
||||
self._mon(mon, [
|
||||
{'key': modem_api.LOG_WAN_FAILED, 'ts': now, 'device': 'UDM', 'wan': 'WAN1'},
|
||||
{'key': modem_api.LOG_WAN_RESTORED, 'ts': now + 90, 'device': 'UDM', 'wan': 'WAN1'},
|
||||
])
|
||||
mon._process_wan_log([])
|
||||
assert not mon.tickets.create.called
|
||||
saved = dict((c.args[0], c.args[1]) for c in db.set_state.call_args_list)
|
||||
assert saved['wan_history']['outages'][0]['restored_at'] == now + 90
|
||||
|
||||
def test_unstable_wan_tickets_once_a_day(self, mon, db):
|
||||
now = time.time()
|
||||
history = json.dumps({'outages': [], 'restarts': [], 'unstable_ticketed_at': now - 3600})
|
||||
self._state(db, unifi_log_cursor=str(int(now * 1000)), wan_history=history)
|
||||
self._mon(mon, [{'key': modem_api.LOG_WAN_UNSTABLE, 'ts': now, 'device': 'UDM', 'wan': 'WAN1'}])
|
||||
mon._process_wan_log([])
|
||||
assert not mon.tickets.create.called
|
||||
|
||||
def test_unstable_wan_tickets_after_a_day(self, mon, db):
|
||||
now = time.time()
|
||||
self._state(db, unifi_log_cursor=str(int(now * 1000)))
|
||||
self._mon(mon, [{'key': modem_api.LOG_WAN_UNSTABLE, 'ts': now, 'device': 'UDM', 'wan': 'WAN1'}])
|
||||
mon._process_wan_log([])
|
||||
assert 'unstable' in mon.tickets.create.call_args.args[0]
|
||||
|
||||
def test_suppression_blocks_one_shot_ticket(self, mon, db):
|
||||
now = time.time()
|
||||
db.check_suppressed.return_value = True
|
||||
self._state(db, unifi_log_cursor=str(int(now * 1000)))
|
||||
self._mon(mon, [{'key': modem_api.LOG_MODEM_RESTARTED, 'ts': now, 'device': 'RPDU', 'wan': ''}])
|
||||
mon._process_wan_log([])
|
||||
assert not mon.tickets.create.called
|
||||
|
||||
def test_uptime_going_backwards_records_a_restart(self, mon, db):
|
||||
self._state(db, modem_stats=json.dumps({'uptime_s': 5000}))
|
||||
mon._note_modem_restart({'uptime_s': 60})
|
||||
saved = dict((c.args[0], c.args[1]) for c in db.set_state.call_args_list)
|
||||
assert len(saved['wan_history']['restarts']) == 1
|
||||
|
||||
def test_uptime_going_forward_records_nothing(self, mon, db):
|
||||
self._state(db, modem_stats=json.dumps({'uptime_s': 5000}))
|
||||
mon._note_modem_restart({'uptime_s': 5300})
|
||||
assert not db.set_state.called
|
||||
|
||||
|
||||
class TestUnifiDeviceDetail:
|
||||
def test_parses_string_stats_and_outlets(self):
|
||||
d = monitor.UnifiClient._device_detail({
|
||||
'version': '7.0', 'uptime': 10, 'system-stats': {'cpu': ' 2.4 ', 'mem': 'bad'},
|
||||
'outlet_table': [{'index': 13, 'name': 'AT&T Modem', 'relay_state': True,
|
||||
'cycle_enabled': True, 'outlet_power': '0.000'}],
|
||||
'wan1': {'up': True, 'speed': 1000, 'latency': 15, 'availability': 100},
|
||||
})
|
||||
assert d['cpu_pct'] == 2.4 and d['mem_pct'] is None
|
||||
assert d['outlets'][0]['auto_power_cycle'] is True and d['outlets'][0]['power_w'] == 0.0
|
||||
assert d['wan']['wan1']['speed_mbps'] == 1000
|
||||
assert 'wan2' not in d['wan']
|
||||
|
||||
def test_system_log_filters_and_paginates(self):
|
||||
c = monitor.UnifiClient({'controller': 'https://u.test', 'api_key': 'k'})
|
||||
page = MagicMock()
|
||||
page.json.side_effect = [
|
||||
{'data': [
|
||||
{'key': modem_api.LOG_MODEM_RESTARTED, 'timestamp': 2000, 'parameters': {'DEVICE': {'name': 'RPDU'}}},
|
||||
{'key': 'CLIENT_CONNECTED_WIRED_2', 'timestamp': 2000},
|
||||
{'key': modem_api.LOG_WAN_FAILED, 'timestamp': 500},
|
||||
]},
|
||||
{'data': []},
|
||||
]
|
||||
c.session.post = MagicMock(return_value=page)
|
||||
got = c.get_system_events(1000, modem_api.WAN_LOG_KEYS)
|
||||
assert got == [{'key': modem_api.LOG_MODEM_RESTARTED, 'ts': 2.0, 'device': 'RPDU', 'wan': ''}]
|
||||
|
||||
def test_system_log_failure_is_none_not_empty(self):
|
||||
c = monitor.UnifiClient({'controller': 'https://u.test', 'api_key': 'k'})
|
||||
c.session.post = MagicMock(side_effect=OSError('boom'))
|
||||
assert c.get_system_events(0, modem_api.WAN_LOG_KEYS) is None
|
||||
|
||||
|
||||
class TestLldpCollection:
|
||||
def _client_with(self, entry):
|
||||
c = monitor.UnifiClient({'controller': 'https://u.test', 'api_key': 'k'})
|
||||
resp = MagicMock()
|
||||
resp.json.return_value = {'data': [{
|
||||
'type': 'usw', 'name': 'sw', 'lldp_table': [entry],
|
||||
'port_table': [{'port_idx': 3, 'name': 'Port 3'}],
|
||||
}]}
|
||||
c.session.get = MagicMock(return_value=resp)
|
||||
return c
|
||||
|
||||
def test_current_unifi_field_name(self):
|
||||
ports = self._client_with({'local_port_idx': 3, 'chassis_id': 'aa'}).get_switch_ports()['sw']['ports']
|
||||
assert ports['Port 3']['lldp']['chassis_id'] == 'aa'
|
||||
|
||||
def test_older_unifi_field_name(self):
|
||||
ports = self._client_with({'lldp_port_idx': 3, 'chassis_id': 'aa'}).get_switch_ports()['sw']['ports']
|
||||
assert ports['Port 3']['lldp']['chassis_id'] == 'aa'
|
||||
|
||||
def test_bond_does_not_hide_its_member_nic(self):
|
||||
collector = monitor.LinkStatsCollector.__new__(monitor.LinkStatsCollector)
|
||||
collector.prom = MagicMock()
|
||||
collector.unifi = MagicMock()
|
||||
collector.unifi.get_wired_clients.return_value = []
|
||||
mac = 'aa:bb:cc:dd:ee:ff'
|
||||
collector.prom.query.return_value = [
|
||||
{'metric': {'device': 'bond0', 'address': mac, 'instance': '10.0.0.1:9100'}},
|
||||
{'metric': {'device': 'eth0', 'address': mac, 'instance': '10.0.0.1:9100'}},
|
||||
{'metric': {'device': 'vmbr0', 'address': mac, 'instance': '10.0.0.1:9100'}},
|
||||
]
|
||||
switches = {'sw': {'ports': {'p': {'lldp': {'chassis_id': 'x', 'port_id': mac.upper()}}}}}
|
||||
collector._resolve_neighbors(switches, {}, {'10.0.0.1:9100': 'alpha'})
|
||||
lldp = switches['sw']['ports']['p']['lldp']
|
||||
assert (lldp['system_name'], lldp['port_id']) == ('alpha', 'eth0')
|
||||
|
||||
def test_client_list_failure_is_empty(self):
|
||||
c = monitor.UnifiClient({'controller': 'https://u.test', 'api_key': 'k'})
|
||||
c.session.get = MagicMock(side_effect=OSError('boom'))
|
||||
assert c.get_wired_clients() == []
|
||||