Network Troubleshooting
About the Picture
The picture you selected was taken in the lab setup located at the Department of Transportation Communications Building. Please forgive the mess, it was inherited and I have not taken time to clean it up since I am often on the run to the next fix. Covering two Statewide Networks has been a difficult task.
My current networks https://www.ok.gov/cio/documents/SolicitationConnectOklahomaAppendix1.pdf
Layer 1 - Physical Layer (PHY)
Missing any of the following tests when preparing your physical layer may lead to problems in the future.
Physical Mediums
Wireless
- Conduct a Path (Elevation/Obstruction) Analysis.
- Conduct a Frequency Analysis of the path and expected coverage area (AKA Spectrum Sweep).
- Determine frequency band and assignment.
- Verify grounding compliance.
- Conduct a path interference analysis (Intentional Radiators, Unintentional Radiators and Incidental Radiators).
- Calculate availability (MTBF and MTTR).
- Align antennas.
- Determine Equivalent Isotropic Radiated Power (EIRP).
- Determine Antenna Gain.
- (Optional) Determine theoretical max transmission.
- Test power transmission with power meter for carrier microwave.
- Conduct signal loss and interference analysis using spectrum analyzer or AirCheck testers.
- Calculate path loss (attenuation) over coverage area.
- For non-path coverage based connection perform signal coverage testing and produce heat-maps.
- Run throughput test with IPerf/JPerf.
- Perform simulation (load) testing.
- Perform in-motion testing.
- Stress testing https://tools.ietf.org/html/rfc2544 in a non-production environment.
Fiber Optics
- Proper splicing technique IAW with ITU-T
- Clean connectors.
- Scope connectors.
- (Optional) Determine theoretical max transmission.
- Test power transmission with power meter
- View loss analysis or breaks with a Visual Fault Locator (VFL) or with Optical Time Domain Reflectometer (OTDR).
- Calculate path loss (attenuation).
- Perform simulation (load) throughput testing using IPerf/JPerf .
- Stress testing https://tools.ietf.org/html/rfc2544 in a non-production environment.
Twisted Pair Copper (UTP/STP)
- CompTIA 568C compliant connectorization for RJ45/CAT level or T1/E1 RJ48C
- (Optional) Determine theoretical max transmission.
- (Optional) Check for breaks with tone/pulse generator with toner probe and/or Time Domain Reflectometer (TDR).
- Conduct acceptance/verification network transmission tests with cable tester.
- (Optional) Calculate voltage loss using a breakout box and multimeter (DMM).
- Calculate path loss (attenuation).
- Determine cross-talk (NEXT, FEXT) and return loss (RL).
- For T1 circuits test with Bit Error Rate Tester (BERT)
- Verify grounding compliance.
- Conduct a path interference analysis (Intentional Radiators, Unintentional Radiators and Incidental Radiators).
- Calculate availability (MTBF and MTTR).
- Perform simulation (load) throughput testing using IPerf/JPerf .
- Stress testing https://tools.ietf.org/html/rfc2544 in a non-production environment.
Coax
- Compliant connectorization for RG-6, RG-58, RG-59
- (Optional) Determine theoretical max transmission.
- (Optional) Check for breaks with tone/pulse generator with toner probe and/or Time Domain Reflectometer (TDR).
- (Optional) Check for distance to fault using Frequency Domain Relectometer (FDR).
- Conduct signal loss test using a spectrum analyzer.
- (Optional) Calculate voltage loss using a breakout box and multimeter (DMM).
- Calculate path loss (attenuation).
- Verify grounding compliance.
- Conduct a path interference analysis (Intentional Radiators, Unintentional Radiators and Incidental Radiators).
- Calculate availability (MTBF and MTTR).
- Perform simulation (load) throughput testing using IPerf/JPerf .
- Stress testing https://tools.ietf.org/html/rfc2544 in a non-production environment.
Serial (RS-232/RS-422)
- Determine connection pinout.
- Determine Data Communications Equipment (DCE)/Data Terminal Equipment (DTE)
- Serial Loopback Testing
- Determine connection settings.
- Connection testing using Hyperterminal or RS-232 program.
- Perform simulation testing.
Parallel
Functions
Transmission Modes
Negotiation
Bit Rate
Point to Point (P2P)
Point to Multi-point (P2MP)
Network Topology
Modulation
Line Coding
Bit Sync
Signal Flow Controls
Circuit Switching
Multiplexing
Carrier Sense
Collision Detection
Signal Processing
Forward Error Correction
Channel Coding
Layer 2 - DataLink Layer
Layer 3 - Network Layer
Layer 4 - Transport Layer
Layer 5 - Session Layer
Layer 6 - Presentation Layer
Layer 7 - Application Layer
https://www.nanog.org/
Troubleshooting MPLS
Troubleshooting VoIP/RoIP
General
- Scope: Endpoint or endpoints.
- Time dependent failure?
- Receive Packet Loss or Receive Packet Discard.
- Packet loss or errors?
- Duplex mismatch?
- Network Congestion?
- QoS enabled
- Flow Analyzed
- Transient flapping link?
- Overloaded Control Unit or DSP?
- High Jitter?
- Packets out of order because route change?
- Monitor with Software
- Call quality. Mean Opinion Score (MOS)
Connection
RTP and RTCP https://tools.ietf.org/html/rfc1889
RTP FAQ http://www.cs.columbia.edu/~hgs/rtp/faq.html#transport
http://www.nojitter.com/post/240164279/troubleshooting-voip-packet-loss
http://www.voiptroubleshooter.com/basics/index.html
http://www.voipmechanic.com/aboutus.htm
QoS
http://www.cisco.com/c/en/us/td/docs/ios/solutions_docs/qos_solutions/QoSVoIP/QoSVoIP.html
https://touchtone.net/Business-Phone/Cisco-VoIP-QoS.pdf
Call Quality
https://www.netcor.de/download.php?file=1587
Tools
https://wiki.wireshark.org/VoIP_calls
https://wiki.wireshark.org/RTP_statistics
https://www.voip-info.org/wiki/view/How+To+Debug+and+Troubleshoot+VOIP
Proprietary
http://www.w5dpd.org/Manuals/NXU-2/OverView/NXU2.pdf
http://www.alcatelunleashed.com/viewtopic.php?t=24065
http://www.alcatelunleashed.com/viewtopic.php?t=16548
http://www.alcatelunleashed.com/viewtopic.php?t=16197
http://download.skype.com/share/business/guides/skype-connect-troubleshooting-guide.pdf