Colocated Hub » History » Version 25
laforge, 09/29/2022 06:48 PM
1 | 2 | laforge | {{>toc}} |
---|---|---|---|
2 | |||
3 | 1 | laforge | h1. Colocated Hub |
4 | |||
5 | 22 | laforge | This page existed to collect information about the new (Sept 2022) colocated OCTOI hub, see #5542 |
6 | |||
7 | 2 | laforge | |
8 | 14 | laforge | h2. Block Diagrams |
9 | |||
10 | h3. E1/TDM network |
||
11 | |||
12 | {{graphviz_link() |
||
13 | graph G { |
||
14 | subgraph cluster_colo { |
||
15 | label = "Co-Located Hub"; |
||
16 | divf [label="DIVF\nCentral Switch",shape="house"]; |
||
17 | icE1usb; |
||
18 | pm3 [label="Livingston Portmaster 3"]; |
||
19 | as54 [label="Cisco AS5400"]; |
||
20 | icE1usb -- divf [label="E1 (timing master)"]; |
||
21 | pm3 -- divf [label="E1"]; |
||
22 | 20 | laforge | as54 -- divf [label="7xE1"]; |
23 | 14 | laforge | } |
24 | divf -- laforge [label="TDMoIP"]; |
||
25 | divf -- manawyrm [label="TDMoIP"]; |
||
26 | divf -- gruetzkopf [label="TDMoIP"]; |
||
27 | divf -- roox [label="TDMoIP"]; |
||
28 | divf -- DrDeke [label="TDMoIP"]; |
||
29 | etc [label="other users..."]; |
||
30 | divf -- etc [label="TDMoIP"]; |
||
31 | } |
||
32 | }} |
||
33 | |||
34 | 15 | laforge | h3. IP network |
35 | |||
36 | {{graphviz_link() |
||
37 | graph G { |
||
38 | subgraph cluster_colo { |
||
39 | label = "Co-Located Hub"; |
||
40 | vlan [label="VLAN/Switch",shape="rect"]; |
||
41 | divf [label="DIVF\nCentral Switch",shape="house"]; |
||
42 | apu [label="APU (hosting icE1usb)"]; |
||
43 | pm3 [label="Livingston Portmaster 3"]; |
||
44 | as54 [label="Cisco AS5400"]; |
||
45 | |||
46 | |||
47 | vlan -- divf; |
||
48 | vlan -- apu; |
||
49 | vlan -- pm3; |
||
50 | vlan -- as54; |
||
51 | } |
||
52 | lakshmi [label="Firewall\n(lakshmi)"]; |
||
53 | public_v4 [label="Internet (IPv4)"]; |
||
54 | public_v6 [label="Internet (IPv6)"]; |
||
55 | 17 | laforge | divf -- lakshmi [label="VLAN 257"]; |
56 | 15 | laforge | lakshmi -- public_v4; |
57 | lakshmi -- public_v6; |
||
58 | } |
||
59 | }} |
||
60 | 1 | laforge | |
61 | 23 | laforge | h2. Pictures |
62 | |||
63 | h3. Rack setup |
||
64 | |||
65 | This picture shows OCTOI hub equipment + some other machines of @laforge: |
||
66 | |||
67 | 24 | laforge | {{thumbnail(octoi_hub-colocated.jpg, size=700)}} |
68 | 23 | laforge | |
69 | h3. GPS antenna |
||
70 | |||
71 | 24 | laforge | {{thumbnail(20220919_130715.jpg, size=400)}} |
72 | 23 | laforge | |
73 | |||
74 | h3. GPS receiver, PSU, OVP |
||
75 | |||
76 | 24 | laforge | {{thumbnail(octoi_hub-gps.jpg, size=500)}} |
77 | 23 | laforge | |
78 | 4 | laforge | h2. Rackmount units |
79 | 1 | laforge | |
80 | 4 | laforge | h3. Central Office server (2U / 67cm) |
81 | 1 | laforge | |
82 | 4 | laforge | This is a 2U rack-mount server running all the relevant software. |
83 | 1 | laforge | |
84 | 4 | laforge | See [[AVSt_Server]] for more details of the server |
85 | 1 | laforge | |
86 | 4 | laforge | h4. Connections |
87 | 1 | laforge | |
88 | 4 | laforge | This is a 2U rack-mount server with the following connections: |
89 | * Power |
||
90 | 10 | laforge | ** 2x AC power connections (redundant PSU) |
91 | 4 | laforge | * Ethernet |
92 | ** 1x RJ45 100-Base-TX BMC |
||
93 | ** 2x RJ45 1000-Base-TX |
||
94 | * E1 |
||
95 | 20 | laforge | ** 87 E1 to a co-located Cisco AS5400 (see below) |
96 | 4 | laforge | ** 1x E1 to a co-located Livingston PM3 (see below) |
97 | ** 1x E1 to icE1usb/clock-source |
||
98 | 20 | laforge | ** 2x E1 used with loop-back cable to provide proper timing from master card to slave card (timing cable has residual clock drift) |
99 | 1 | laforge | |
100 | 4 | laforge | h3. icE1usb / E1 clock source (1U / 31cm) |
101 | 1 | laforge | |
102 | 23 | laforge | |
103 | 4 | laforge | This is a 1U rack mount system containing: |
104 | * a PC-Engines APU3 embedded x86_64 |
||
105 | * an [[e1-t1-adapter:ICE40_E1_USB_interface|icE1usb]] with a custom RS422 interface board |
||
106 | * a custom rs422 over voltage protection + 12V injection board |
||
107 | 1 | laforge | |
108 | This icE1usb acts as a GPS-disciplined clock master. However, as no acutal RF GPS signal is available in the data centre, we are using an Ericsson [[ericsson-rbs-6xxx:GPS_02]] attached via ~100m of RS-422. |
||
109 | 23 | laforge | |
110 | 24 | laforge | {{thumbnail(20220905_205638.jpg, size=500)}} |
111 | 1 | laforge | |
112 | 25 | laforge | {{thumbnail(20220831_204322.jpg)}} |
113 | 1 | laforge | |
114 | 4 | laforge | h4. Connections |
115 | 1 | laforge | |
116 | 4 | laforge | * Power |
117 | ** 2x AC power connections (1x APU, 1x RS422/GPS) |
||
118 | * Ethernet |
||
119 | 8 | laforge | ** 1x RJ45 to internal VLAN |
120 | 4 | laforge | * RS422 |
121 | 1 | laforge | ** 1x RJ45 towards GPS02 on the roof |
122 | |||
123 | 4 | laforge | h3. Cisco AS5400 RAS Server (2U / 49cm) |
124 | 1 | laforge | |
125 | 4 | laforge | h4. Connections |
126 | 1 | laforge | |
127 | 4 | laforge | * Power |
128 | ** 2x AC power connection (redundant PSU) |
||
129 | * Ethernet |
||
130 | ** 1x RJ45 Ethernet (100-Base-TX) to internal VLAN |
||
131 | * E1 |
||
132 | ** 8x E1 (via break-out cable) to AVSt-Server |
||
133 | 7 | laforge | * RS232 |
134 | ** Serial console connection via USB-UART to [[AVSt_Server]] |
||
135 | 4 | laforge | |
136 | h3. Livingstion Portmaster 3 (2U / 31cm) |
||
137 | |||
138 | h4. Connections |
||
139 | |||
140 | * Power |
||
141 | ** 1x AC power connection |
||
142 | * Ethernet |
||
143 | 9 | laforge | ** 1x RJ45 Ethernet (10-Base-TX) [yes, 10MBps] to internal VLAN |
144 | 4 | laforge | * E1 |
145 | ** 1x E1 to AVSt-Server |
||
146 | 6 | laforge | * RS232 |
147 | ** Serial console connection via USB-UART to [[AVSt_Server]] |
||
148 | 4 | laforge | |
149 | h2. Roof installation |
||
150 | |||
151 | |||
152 | On the roof of the data centre, the CAT5 cable with RS422 for the GPS03 arrives. |
||
153 | |||
154 | It will be passed through several DIN rail mounted OVP (Over Voltage Protection) circuits before connecting to the actual DIN-rail mounted Ericsson GPS03 |
||
155 | |||
156 | The Ericsson GPS03 has a SMA connector, to which a SMA-male to N-Male coaxial cable is attached. |
||
157 | |||
158 | A Times Microwave LP-GTR-NFF lightning protector (N-female to N-femaile) is used to pass the coaxial cable through the enclosure |
||
159 | |||
160 | An external GPS antenna with N connector is plugged into the LP-GTR-NFF |
||
161 | 1 | laforge | |
162 | 5 | laforge | h3. Overview diagram |
163 | 1 | laforge | |
164 | 5 | laforge | This diagram illustrates the parts and connections on the rooftop. Rectangular objects are DIN-rail mounted. |
165 | 1 | laforge | |
166 | 5 | laforge | {{graphviz_link() |
167 | graph G { |
||
168 | subgraph cluster_1 { |
||
169 | label="Rooftop enclosure"; |
||
170 | rj45splitter [label="RJ45 splitter"]; |
||
171 | GPS03 [label="Ericsson GPS03", shape=rect]; |
||
172 | ovp_rs422_1 [shape=rect]; |
||
173 | ovp_rs422_2 [shape=rect]; |
||
174 | ovp_rs422_3 [shape=rect]; |
||
175 | ovp_12v [shape=rect]; |
||
176 | lp [label="LP-GTR-NFF"]; |
||
177 | rj45splitter -- ovp_rs422_1; |
||
178 | rj45splitter -- ovp_rs422_2; |
||
179 | rj45splitter -- ovp_rs422_3; |
||
180 | rj45splitter -- ovp_12v; |
||
181 | ovp_rs422_1 -- GPS03; |
||
182 | ovp_rs422_2 -- GPS03; |
||
183 | ovp_rs422_3 -- GPS03; |
||
184 | ovp_12v -- GPS03; |
||
185 | GPS03 -- lp [label="SMA-male/N-female"]; |
||
186 | } |
||
187 | antenna [label="GPS Antenna"]; |
||
188 | antenna -- lp [label="RG58 white / N-female"]; |
||
189 | rack [label="Rack in DC"]; |
||
190 | rack -- rj45splitter [label="CAT5"]; |
||
191 | } |
||
192 | }} |
||
193 | 2 | laforge | |
194 | 1 | laforge | h2. Software |
195 | |||
196 | 3 | laforge | * Like in the current hub at @laforge's basement, we should run the entire yate / osmo-e1d / dahdi-trunkdev inside a KVM with SRV-IO mapping the PCI devices |
197 | |||
198 | 16 | laforge | h2. Network |
199 | |||
200 | h2. Public IP |
||
201 | |||
202 | |_.Host|_.IPv4|_.IPv6|_.IPv4-internal| |
||
203 | |avst|213.95.46.30|?|192.168.7.129/25| |
||
204 | |divf|213.95.46.31|?|192.168.7.130/25| |
||
205 | |as5400|213.95.46.29|?|192.168.7.133| |
||
206 | |pm3|-|-|192.168.7.132| |
||
207 | |icE1-apu|-|-|192.168.7.131| |
||
208 | 21 | laforge | |stats|213.95.46.27|-|192.168.7.134| |
209 | 16 | laforge | |avst-bmc|213.95.46.28|?|-| |
210 | 3 | laforge | |
211 | h2. Misc / TODO |
||
212 | |||
213 | h3. local verification with modem/ISDN-TA |
||
214 | |||
215 | It would be great if we could somehow verify local calls via the yate / hub excluding the complexity of the TDMoIP to compare calls without TDMoIP to calls with TDMoIP. |
||
216 | |||
217 | Unfortuantely I'm not aware of any really small PBX that would terminate the E1/S2M and offer S0/POTS ports. Adding antoher 3U for a PBX seems excessive. |
||
218 | |||
219 | 1 | laforge | Doing calls between PM3 and ASR5400 is of course an option, but ideally we'd have a real physical modem attached via a serial port, and a real HFC-S-USB for test purpose. |
220 | 11 | laforge | |
221 | h2. High-level parameters for data centre |
||
222 | |||
223 | * 7U rackspace |
||
224 | * 7x AC power outlet |
||
225 | 13 | laforge | * 7x Ethernet switch port (one of which supports 10 MBps!) |
226 | 11 | laforge | ** some ports in a new VLAN |
227 | ** some ports in an existing VLAN of my other servers in Rack 1120 |
||
228 | * 1x CAT5 between rack and roof |
||
229 | * about 10cm of space on DIN-rail on roof enclosure (to mount OVP + GPS03) |
||
230 | |||
231 | h2. Questions |
||
232 | 1 | laforge | |
233 | 12 | laforge | * Required antenna cable length between rooftop enclosure and antenna |
234 | * Mechanical antenna mounting details |
||
235 | 11 | laforge | * detailed switch port / VLAN config |