CMDB Lite Discovery Data Management

Owned by Allena Kendrick (Unlicensed)
Oct 04, 2019







CMDB Lite Project


ServiceNow Discovery Data Management
this is a living artifact






Authored by Allena Kendrick, ServiceNow Solutions Artifact
Table of Contents
Discovery Overview
Overall CMDB Tables
Approved CMDB Tables that will be populated by Discovery
CMDB Table: Linux Server(cmdb_ci_linux_server)
Discovery Probes/Patterns
Linux Class Relationship
Linux Class Schema
CMDB Table: VmWare (cmdb_ci_vmware_instance)
VMWare Data collected
VMWare Relationships
VMWare Schema
CMDB Table: Storage (cmdb_storage_server)
Discovery Probes/Patterns
Storage Data collected by NetApp patterns
Storage Relationships
Storage Schema
CMDB Table: Oracle(oracle_db_instance)
Discovery Probes/Patterns
Oracle Data Collection
Oracle Relationships
Oracle Schema
CMDB Table: Big F5 IP(cmdb_ci_ib_bigip)
Discovery Probes/Patterns
F5 Big-IP Data collected
F5 BiG IP Relationship
F5 BIG IP Schema
CMDB Table: MSSQL(cmdb_mssql_instance)
Discovery Probes/Patterns
MSSQL Data collection
MSSQL Relationships
MSSQL Schema
CMDB Tables: Network (Router and Switch Data)
cmdb_ci_ip_router
cmdb_ci_ip_switch
Discovery Probes/patterns
Network Data collected
IP Router Relationship
IP Router Schema(cmdb_ci_ip_router
Switch Relationship(cmdb_ci_ip_switch)
Switch schema (cmdb_ci_ip_switch)
CMDB Table: Windows(cmdb_ci_windows_server)
Windows Relationships
Windows Schema
Aperture
Rack Relationship (cmdb_ci_rack)
Power Relationships (cmdb_ci_datapower_server)













Discovery Overview



Overall CMDB Tables


This is the overall CMDB data model that discovery populates using probes and patterns. Note: Ownership data is not populated by discovery.
Probes and patterns collect the information and the sensor processes it. Both get their instructions from the ECC queue. There is a worker job on the MID Server that monitors the queue for work. The monitor checks for any entries where the Queue is output and the State is ready.

Approved CMDB Tables that will be populated by Discovery


The following are the approved CMDB tables(class) to-date by the CMDB Lite Steering Committee.

CMDB Table: Linux Server(cmdb_ci_linux_server)


Discovery Probes/Patterns


 

Classifier

Probes

Pattern

Linux
(Unix classification))
  • Horizontal discovery probe: launches patterns
  • Linux - Installed Software^
  • Unix - ADM^
  • Linux - Identity*
  • Linux - CPU*
  • Linux - Distribution*
  • Linux - Find FQDN*
  • Linux - Memory*
  • Linux - Memory Modules*
  • Linux - Network ARP Tables*
  • Linux - Storage*
  • Linux - Amazon EC2*
  • Unix - OS Uptime*
  • UNIX - OS Filesystems*
  • UNIX - Find FQDN*
  • Unix - ADM Enhanced*

 




Linux Class Relationship




Linux Class Schema


CMDB Table: VmWare (cmdb_ci_vmware_instance)


VMWare Data collected


Label

Table Name

Field Name

CPUs

cmdb_ci_vm_instance

cpus

Disks

cmdb_ci_vm_instance

disks

Disks size

cmdb_ci_vm_instance

disks_size

Memory

cmdb_ci_vm_instance

memory

Network adapters

cmdb_ci_vm_instance

nics

State

cmdb_ci_vm_instance

state

Image path

cmdb_ci_vmware_instance

image_path

Template

cmdb_ci_vmware_instance

template

vCenter Reference

cmdb_ci_vmware_instance

vcenter_ref

vCenter Reference UUID

cmdb_ci_vmware_instance

vcenter_uuid














VMWare Relationships


VMWare Schema


CMDB Table: Storage (cmdb_storage_server)


Discovery Probes/Patterns



Storage Data collected by NetApp patterns



Table

Fields

cmdb_ci_storage_server

name
firmware_version
cluster
serial_number
manufacturermode
model_id
cim_object_path
short_description
ip_address

cmdb_ci_storage_cluster

short_description
ip_address
manufacturer

cmdb_ci_storage_cluster_node

name
operational_status

cmdb_ci_storage_node_element

cluster
short_description
manufacturer
serial_number
model_id
ram
cpu_type
cpu_manufaturer
cpu_core_count

cmdb_ci_network_adapter

name
ip_address
netmask
cmdb_ci

cmdb_serial_number

serial_number
serial_number_type

cmdb_ci_ip_address

ip_address
netmask
nic
ip_version (Storage-7 mode)
name

cmdb_ci_disk

name
device_id
serial_number
manufacturer
model_id
storage_type
device_interface
size_bytes
computer

cmdb_ci_storage_fileshare

path
name

cmdb_ci_storage_pool

name
short_description
free_space_bytes
pool_id
size_bytes

cmdb_ci_storage_volume

name
lun
volume_id

cmdb_ci_iscsi_export

name
lun
initiator_iqn
iqn
export_id

cmdb_ci_storage_controller

name
device_id

cmdb_ci_fc_export

initiator_wwpn
export_id
name
lun

cmdb_ci_fc_port

speed
name
wwnn
wwpn























Storage Relationships



Storage Schema



CMDB Table: Oracle(oracle_db_instance)


Discovery Probes/Patterns








Oracle Data Collection

Oracle Relationships



Oracle Schema


CMDB Table: Big F5 IP(cmdb_ci_ib_bigip)


Discovery Probes/Patterns

Classifiers

Trigger probes

Patterns

F5 BIG-IP Load Balancer
  • Horizontal discovery probe: launches patterns

These patterns are used for standard horizontal discovery including identifying clusters:

  • F5 Load Balancer
  • F5 Load Balancer SSH
  • F5 Load Balancer REST

F5 HTTP

The F5 HTTP classifier does not use a trigger probe. It triggers the F5 Load Balancer REST pattern to perform data collection via REST.

These patterns use iRules to get information via REST. Service Mapping uses these patterns for top-down discovery:

  • F5 Load Balancer REST
  • F5 BigIP GTM
  • F5 BigIP LTM


F5 Big-IP Data collected


Table and field

Description

F5 Big-IP [cmdb_ci_lb_bigip]

 

Name [name]

Details about the load balancer. View a record in this table to see the upstream and downstream relationships with the load balancer.

Serial Number [serial_number]

 

Operational Status [operational_status]

 

 

 

Load Balancer Interface [cmdb_ci_lb_interface]

 

Name [name]

Details about each interface for the load balancer.

MAC Address [mac_address]

 

Operational Status [operational_status]

 

 

 

Load Balancer Pool [cmdb_ci_lb_pool]

 

Name [name]

The name of the pool and the method of load balancing it enables.

Load balancing method [load_balancing_method]

 

 

 

Load Balancer Pool Member [cmdb_ci_lb_pool_member]

 

Name [name]

The name, IP address, and service port that each pool member uses.

IP Address [ip_address]

 

Service Port [service_port]

 

Pool [pool]

 

 

 

Load Balancer VLAN [cmdb_ci_lb_vlan]

 

Name [name]

The name of the VLAN and the tag that is associated with this VLAN to identify it.

Tag [tag]

 

MAC Address [mac_address]

 

 

 

Load Balancer Services [cmdb_ci_lb_service]

 

Name [name]

Details about the load balancer service that distributes the workload to other servers, such as web servers.

IP Address [ip_address]

 

Port [port]

 

Operational Status [operational_status]

 

Hit count [hit_count]

 

 

 

DNS [cmdb_ci_dns_name]

 

Name [name]

The name and IP address of the Domain Name Server for the network adapters.

IP Address [ip_address]

 

 

 

Network Adapter [cmdb_ci_network_adapter]

 

Name [name]

Details about the network adapters on the load balancer.

IP Address [ip_address]

 

Netmask [netmask]

 

Mac address [mac_address]

 

 

 

Cluster [cmdb_ci_cluster]

 

Name [name]

Details about the load balancer cluster.

Cluster status [cluster_status]

 

Cluster ID [cluster_id]

 

IP address [ip_address)]

 

 

 

Cluster Node [cmdb_ci_cluster_node]

 

Name [name]

Details about each node in a cluster.

Cluster ID [cluster_id]

 

Cluster status [cluster_status]

 




















F5 BiG IP Relationship



F5 BIG IP Schema


CMDB Table: MSSQL(cmdb_mssql_instance)


Discovery Probes/Patterns


Classifier

Trigger probes

Pattern

Microsoft SQL Server
  • Horizontal discovery probe: launches patterns
  • Windows - MSSQL{}*

MSSql DB On Windows Pattern


MSSQL Data collection


Label

Field name

Name

name

Instance

instance_name

TCP port

tcp_port

Portdynamic

port_dynamic

Version name

version_name

Edition

edition

Version

version

Engine edition

engine_edition

Install directory*

install_directory

CPU sockets*

cpu_sockets

Service Pack*

service_pack



















MSSQL Relationships



MSSQL Schema

CMDB Tables: Network (Router and Switch Data)

cmdb_ci_ip_router

cmdb_ci_ip_switch


Discovery Probes/patterns

classifiers

Trigger probes

Patterns

Standard Network Router
Standard Network Switch
  • Horizontal Pattern: launches patterns
  • SNMP-Routing^
  • DNS*
  • SNMP-Identity*
  • SNMP-Switch-Vlan*
  • SNMP-Switching*
  • SNMP - Network - ArpTable* (Standard Network Switch only)

Network Router
Network Switch



Network Data collected


Label

Table name

Field name

Source

Serial number

cmdb_ci

serial_number

SNMP, various MIBs

Start date (only when target is a host)

cmdb_ci

start_date

SNMP, RFC1213 MIB

Manufacturer

cmdb_ci

manufacturer

SNMP, RFC1213 MIB

Model ID

cmdb_ci

model_id

SNMP, RFC1213 MIB

IP address

cmdb_ci_network_adapter

ip_address

SNMP, IP MIB

MAC address

cmdb_ci_network_adapter

mac_address

SNMP, IF MIB

Can route IP

cmdb_ci_netgear

can_route

SNMP, IP MIB, BGP MIB

Can switch IP

cmdb_ci_netgear

can_switch

SNMP, dot1dBridge MIB

Can partition VLANs

cmdb_ci_netgear

cdscy_router_interface

SNMP, dot1dBridge MIB

Can hub

cmdb_ci_netgear

can_hub

SNMP, IP MIB

Neighbor Address

discovery_device_neighbors

neighbor_address

ciscoCdpMIB, lldpMIB

Neighbor ID

discovery_device_neighbors

neighbor_id

ciscoCdpMIB, lldpMIB

Neighbor Interface

discovery_device_neighbors

neighbor_interface

ciscoCdpMIB, lldpMIB

Neighbor Source

discovery_device_neighbors

neighbor_source

ciscoCdpMIB, lldpMIB

Origin Interface

discovery_device_neighbors

origin_interface

ciscoCdpMIB, lldpMIB

IP Address

discovery_net_arp_table

ip_address

SNMP, IP MIB

MAC Address

discovery_net_arp_table

mac_address

SNMP, IP MIB

Name

dscy_router_interface

name

SNMP, IP MIB

Type

dscy_router_interface

type

SNMP, IP MIB

Number

dscy_router_interface

number

SNMP, IP MIB

IP address

dscy_router_interface

ip_address

SNMP, IP MIB

MAC address

dscy_router_interface

mac_address

SNMP, IP MIB

Destination network

dscy_route_interface

dest_ip_network

SNMP, IP MIB

Type

dscy_route_interface

type

SNMP, IP MIB

Destination network

dscy_route_next_hop

dest_ip_network

SNMP, IP MIB

Type

dscy_route_next_hop

type

SNMP, IP MIB

Next hop

dscy_route_next_hop

next_hop_ip_address

SNMP, IP MIB

Interface Index

discovery_switch_bridge_port_table

interface_index

SNMP, dot1dBridge MIB

Port

discovery_switch_bridge_port_table

port

SNMP, dot1dBridge MIB

MAC Address

discovery_switch_fwd_table

mac_address

SNMP, dot1dBridge MIB

Port

discovery_switch_fwd_table

port

SNMP, dot1dBridge MIB

Status

discovery_switch_fwd_table

status

SNMP, dot1dBridge MIB

VLAN Id

discovery_switch_fwd_table

vlan_id

SNMP, dot1dBridge MIB

Designatged Bridge MAC

discovery_switch_spanning_tree_table

designated_bridge_mac

SNMP, dot1dBridge MIB

Designated Root

discovery_switch_spanning_tree_table

designated_root

SNMP, dot1dBridge MIB

Port

discovery_switch_spanning_tree_table

port

SNMP, dot1dBridge MIB

Port Enable

discovery_switch_spanning_tree_table

port_enable

SNMP, dot1dBridge MIB

Port State

discovery_switch_spanning_tree_table

port_state

SNMP, dot1dBridge MIB

Base IP address

dscy_swtch_partition

base_ip_address

SNMP, dot1dBridge MIB

Base MAC address

dscy_swtch_partition

base_mac_address

SNMP, dot1dBridge MIB

Base netmask

dscy_swtch_partition

base_netmask

SNMP, dot1dBridge MIB

Type

dscy_swtch_partition

type

SNMP, dot1dBridge MIB

Transparent

dscy_swtch_partition

transparent

SNMP, dot1dBridge MIB

Sourceroute

dscy_swtch_partition

sourceroute

SNMP, dot1dBridge MIB

Name

dscy_swtch_partition

name

SNMP, dot1dBridge MIB

Status

dscy_swtch_partition

status

SNMP, dot1dBridge MIB

Interface number

dscy_swtch_partition

interface_number

SNMP, dot1dBridge MIB

Type

dscy_switchport

type

SNMP, dot1dBridge MIB

Status

dscy_switchport

status

SNMP, dot1dBridge MIB

MAC address

dscy_switchport

mac_address

SNMP, dot1dBridge MIB

Port number

dscy_switchport

port_number

SNMP, dot1dBridge MIB

Interface name

dscy_switchport

interface_name

SNMP, dot1dBridge MIB

Interface number

dscy_switchport

interface_number

SNMP, dot1dBridge MIB

MAC address

dscy_swtch_fwd_rule

mac_address

SNMP, dot1dBridge MIB

MAC manufacturer

dscy_swtch_fwd_rule

mac_mfr

SNMP, dot1dBridge MIB

Status

dscy_swtch_fwd_rule

status

SNMP, dot1dBridge MIB

IP address

dscy_swtch_fwd_rule

ip_address

SNMP, dot1dBridge MIB

Netmask

dscy_swtch_fwd_rule

netmask

SNMP, dot1dBridge MIB

Name

cmdb_ci_ip_switch

name

 

Model ID

cmdb_ci_ip_switch

model_id

SNMP, RFC1213 MIB

Manufacturer

cmdb_ci_ip_switch

manufacturer

SNMP, RFC1213 MIB

Serial Number

cmdb_ci_ip_switch

serial_number

SNMP, various MIBs

IP address

cmdb_ci_ip_switch

ip_address

SNMP, IP MIB

Description

cmdb_ci_ip_switch

short_description

 

Can route IP

cmdb_ci_ip_switch

can_route

SNMP, IP MIB, BGP MIB

Ports

cmdb_ci_ip_switch

ports

SNMP, dot1dBridge MIB

Can switch IP

cmdb_ci_ip_switch

can_switch

SNMP, dot1dBridge MIB

Can partition VLANs

cmdb_ci_ip_switch

can_partionvlans

SNMP, dot1dBridge MIB

Name

cmdb_ci_ip_router

name

 

Model ID

cmdb_ci_ip_router

model_id

SNMP, RFC1213 MIB

Manufacturer

cmdb_ci_ip_router

manufacturer

SNMP, RFC1213 MIB

Serial Number

cmdb_ci_ip_router

serial_number

SNMP, various MIBs

IP address

cmdb_ci_ip_router

ip_address

SNMP, IP MIB

Description

cmdb_ci_ip_router

short_description

 

Can route IP

cmdb_ci_ip_router

can_route

SNMP, IP MIB, BGP MIB

Can switch IP

cmdb_ci_ip_router

can_switch

SNMP, dot1dBridge MIB

 
































IP Router Relationship


 

IP Router Schema(cmdb_ci_ip_router

Switch Relationship(cmdb_ci_ip_switch)




Switch schema (cmdb_ci_ip_switch)



CMDB Table: Windows(cmdb_ci_windows_server)


Data collections will be pulled using SCCM discovery integrations. A data transform will be created to capture the information in the correct data attributes. This include host/domain names.

Windows Relationships



Windows Schema
































Aperture


Aperture database currently contains data center device details. As part of this project, we will be importing the data into the appropriate table noted above. Two additional classes for RACK and Power will be utilized. The RACK and Power data cannot be scanned by discovery.

Rack Relationship (cmdb_ci_rack)














Power Relationships (cmdb_ci_datapower_server)