Ethernet Service OAM/PM November 2011 Seth Higgins, Global Ethernet Applications Carrier Ethernet Service Delivery To replace SONET/SDH or Frame Relay with Ethernet, the edge network must replicate… Connectivity Resiliency PM statistics SLA reporting Legacy transport and service interoperability Timing Balance: IP Core with L2 access and transport IP is good for connectivity, resiliency and interop Routers are bad for true accurate stats and timing Monitoring a hybrid network relies heavily on the endpoints Standards allow added information from core But services are end-to-end, and so must be the monitoring 2 © 2011 ADVA Optical Networking. All rights reserved. Confidential. What are people buying now? SLA’s with substance @ lowest price per performance Tools to operate and troubleshoot Ethernet like SONET Timing distribution: mobile backhaul and algorithmic trading E-Line to E-LAN transition Next step in SONET to Ethernet evolution 3 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Operating an Ethernet Service Business customer LAN Ethernet/IP WAN Service demarcation Turn-up and test Low-touch provisioning + CLI / GUI / SNMP configuration Validate installation with RFC-2544 test and export acceptance report Performance Monitoring Service Assurance stats, e.g. loss, latency and jitter Threshold crossing alarms for all PM attributes Troubleshooting without truck rolls Loopback and throughput/latency test suite Dying Gasp alert and cable integrity check Primary Objectives Reduce truck rolls Accurate and scalable PM EMS/NMS/OSS integration Inventory, alarming, monthly SLA reports… 4 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Mobile Backhaul Killer application for Service Assurance Mobile Operators are transitioning from TDM to TDM-like Ethernet Strict SLA for delay (4ms), jitter (1ms) and loss (0.01%) I-temp, +24VDC, 1RU, Sync distribution 100’s of towers per metro, 1000’s per region OAM/PM must scale at MSC hub Mobile operator must deal consistently with hundreds of access providers UNI Cell site gateway E-NNI OAM reflector NTE MSC gateway Ethernet Transport Aggregation Mobile Operator 5 Access Provider © 2011 ADVA Optical Networking. All rights reserved. Confidential. Mobile Operator Delay Measurement Probe Reflector Message data Service Assurance includes frame loss, delay and jitter Delay measured either roundtrip or one-way (bidirectional) Loss may be a synthetic representation or actual frame counts (p2p) Synthetic frames measure delay Send at negligible and configurable rate Timestamp at both ends for one-way values Customize packet size and classification Collect and report conformance data Alarm on violations 6 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Measuring One-Way Delay Delay from hops (inherit delay) and network congestion Time of Day Synchronization between end-points required e.g. NTP, GPS and 1588v2 Endpoints should reference the same Time of Day source Synchronization errors occur when there is a negative time different between the TX and RX Different Time of Day sources Poor quality TOD source (precision and stratum level) or DCN congestion Inaccurate time client algorithm Delay between timestamp and packet send/receive causes inaccuracy Must timestamp at the moment of send/receive Without hardware-based timestamping software interrupts cause problems Service Assurance NTP Customer Premise, Hub or Cell Tower CO or MSC 7 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Ethernet OAM Areas of standards activities UNI UNI 100FX Media Customer Euqipment Converter Media Carrier Converter Edge MEF & ITU Y.1731 IEEE 802.1Qay Media Customer Converter Equipment MEF NID IEEE 802.3ah EFM Carrier Media Edge Converter Service Layer OAM (UNI to UNI) MEF NID MEF & ITU Y.1731 IEEE 802.1ag 100FX Carrier NW Connectivity Layer OAM Access Link OAM Access Link OAM 802.1ag CFM – Connectivity Fault Management Y.1731 OAM (Operations, Administration and Maintenance) – Service Assurance 802.3ah EFM (Ethernet in the First Mile) – Dying Gasp 8 © 2011 ADVA Optical Networking. All rights reserved. Confidential. IEEE 802.1ag – OAM Maintenance Entities CPE Operator A Provider Bridges Operator B Provider Bridges Customer Domain MD Level=7 Service Provider Domain MD Level=3 Operator Domain Operator Domain MD Level=2 MEP MIP MA Up MEP – CFM traffic is sent towards the bridge (e.g. from LAN towards WAN through the device) Down MEP – CFM traffic is sent away from the bridge (e.g. from WAN towards the network) 9 © 2011 ADVA Optical Networking. All rights reserved. Confidential. CPE ETH-CCM - Continuity Check Messages Periodic multicast message toward other MEPs in the same MA Provides heartbeat for connectivity check Also used for MEP MAC discovery Y.1731 and CFM defined the same function which causes interoperability issues CCM Interval 3.3 msec 10 msec 100 msec 1 sec 10 sec 1 min 10 min C B Operator A Operator B D A Provider Domain MEP 10 MIP © 2011 ADVA Optical Networking. All rights reserved. Confidential. MEP LBM/LBR -Loopback Messages Loopback Messages (LBM) are unicast messages used for fault isolation (similar to ping) LBMs are used to verify the connectivity between two maintenance points - i.e. between two MEPs or between a MEP and MIP At the destination, a Loopback Reply (LBR) is sent back to the sender C B Operator A Operator B D A Provider Domain MEP 11 MIP LBM LRM © 2011 ADVA Optical Networking. All rights reserved. Confidential. LTM/LTR - Link Trace Message Link Trace Messages (LTM) are used for path discovery Sent from the source MEP to the target MEP (or MIP) At each MIP to the target, a Link Trace Response (LTR) message is sent back to the originating MEP Based on the information in the LTRs received, the originating MEP can determine the path to the target MEP C B Operator A Operator B D A Provider Domain MEP 12 MIP LTM LTR © 2011 ADVA Optical Networking. All rights reserved. Confidential. Link-Loss Forwarding Service application of ETH-CC/RDI or AIS Customer Premise Access Metro Core Metro Access Customer Premise 3rd party network Disable Port(s) Link Fault(s) Link activity is local and abstracted by a network in the middle, yet endpoints assume link status represents connectivity Failure anywhere along an EVC propagates to remote site(s) Continuity Check Messages with Remote Defect Indication or Alarm Indication Signal Link change triggers customer protection scheme to respond quickly 13 © 2011 ADVA Optical Networking. All rights reserved. Confidential. ITU Y.1731 – Service Assurance OAM Builds on 802.1ag functionality and adds: Performance monitoring • Delay Measurement (DM), Loss Measurement (LM) • Under Study: Synthetic Loss Measurement (SLM) Additional Fault Management: AIS & RDI Test pattern and test mode (TST) • But no test methodology or standard test suite Automatic Protection Switching (APS) Other not so-common functions: MCC, VSM/EXM, 1DM. Y.1731 Defines its own hierarchical structure and Terminology MEG – Maintenance Entity Group (Similar to MD + MA) MEPs and MIPs keep CFM Definitions Reflector Reflector Probe Unaffected Customer Traffic (generator) IP Network Customer Premise 14 14 Customer Premise © 2011 ADVA Optical Networking. All rights reserved. Confidential. Ethernet Loss Measurement ETH-LM: Loss Measurement of customer data frames Single-ended, on-demand, using ETH-LMM/ETH-LMR Frame Loss measurements are calculated per Y.1731… • Frame Loss (far-end) = |TxFCf[tc] – TxFCf[tp]| - |RxFCf[tc] – RxFCf[tp]| • Frame Loss (near-end) = |TxFCb[tc] – TxFCb[tp]| - |RxFCl[tc] – RxFCl[tp]| ETH-SLM: Synthetic Loss Measurement New OAM function defines a way to measure Frame Loss Ratio Multipoint support, in addition to Point-to-Point connectivity • Use sequence numbers for ETH-SLM/SLR synthetic frames • Count transmitted and received synthetic frames between MEPs 15 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Threshold Crossing Alarms Traps sent on any violation Thresholds must be user configurable Could trigger email alert 16 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Dying Gasp alert Signals alert on power failure IEEE 802.3ah EFM “Dying Gasp” message or SNMP trap 10/100/1000BT Network Dying Gasp 17 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Customer Equipment Test to a loopback Traffic Generator Turn-up & troubleshooting RFC-2544 throughput test VLAN or port loopbacks Terminal or facility direction SA/DA swap for L2 transport Test and turn-up CO or MSC Customer Premise or Cell Tower Test Head 18 © 2011 ADVA Optical Networking. All rights reserved. Confidential. RFC-2544 Testing Benchmarking Methodology for Network Interconnect Devices Suite of tests for verifying Ethernet equipment Also used for Ethernet services Suite of tests defined: Throughput Latency Frame loss Back to back System Recovery Reset MEF SLA parameters Results generally presented in Each test is performed multiple times with different frame sizes (64, 128, 256,…) 19 © 2011 ADVA Optical Networking. All rights reserved. Confidential. graphical form Y.1564 Service Configuration Test Verify throughput performance for each service at CIR, CIR+EIR and above Tests up to CIR to verify committed SLA parameters Then increase the traffic rate into the red zone to verify policing Performance is uncertain in the yellow zone and needn’t be checked Optional CBS/EBS configuration verification All SLA performance parameters measured at the same time Frame Delay, Frame Delay Variation and Frame Loss 20 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Y.1564 Service Performance Test Simultaneously validate SLA conformance for all defined services Generate traffic at CIR for all flows and report performance Test for 15 minutes to 24 hours 21 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Timing distribution and sync verification Trusted Wireline Operator provides Synchronization Service Mobile Operator is customer of the Synchronization Service Both need tools for synchronization service Prove accuracy at time of network deployment Monitor stability in normal operation When things go wrong, diagnostics are required Access and Backhaul Network Trusted Wireline Operator Mobile Network Operator Mobile Network Operator SLA/Stability Meets SLA? UNI Cell Site 22 Backhaul Network © 2011 ADVA Optical Networking. All rights reserved. Confidential. Mobile Core Ubiquitous Ethernet Service SDH/SONET IP/MPLS Network PDH Ethernet Access End-to-end service assurance - Consistent delivery platform - Any access Evolve your embedded base to support contemporary requirements for Mobile Backhaul, Business Ethernet, and Wholesale NNI services 23 © 2011 ADVA Optical Networking. All rights reserved. Confidential. Thank you [email protected] IMPORTANT NOTICE The content of this presentation is strictly confidential. ADVA Optical Networking is the exclusive owner or licensee of the content, material, and information in this presentation. Any reproduction, publication or reprint, in whole or in part, is strictly prohibited. The information in this presentation may not be accurate, complete or up to date, and is provided without warranties or representations of any kind, either express or implied. ADVA Optical Networking shall not be responsible for and disclaims any liability for any loss or damages, including without limitation, direct, indirect, incidental, consequential and special damages, alleged to have been caused by or in connection with using and/or relying on the information contained in this presentation. Copyright © for the entire content of this presentation: ADVA Optical Networking.