Colocated Hub » History » Version 27
sur5r, 09/29/2022 06:52 PM
fix typo
1 | 2 | laforge | {{>toc}} |
---|---|---|---|
2 | |||
3 | 1 | laforge | h1. Colocated Hub |
4 | |||
5 | 22 | laforge | This page existed to collect information about the new (Sept 2022) colocated OCTOI hub, see #5542 |
6 | |||
7 | 2 | laforge | |
8 | 14 | laforge | h2. Block Diagrams |
9 | |||
10 | h3. E1/TDM network |
||
11 | |||
12 | {{graphviz_link() |
||
13 | graph G { |
||
14 | subgraph cluster_colo { |
||
15 | label = "Co-Located Hub"; |
||
16 | divf [label="DIVF\nCentral Switch",shape="house"]; |
||
17 | icE1usb; |
||
18 | pm3 [label="Livingston Portmaster 3"]; |
||
19 | as54 [label="Cisco AS5400"]; |
||
20 | icE1usb -- divf [label="E1 (timing master)"]; |
||
21 | pm3 -- divf [label="E1"]; |
||
22 | 20 | laforge | as54 -- divf [label="7xE1"]; |
23 | 14 | laforge | } |
24 | divf -- laforge [label="TDMoIP"]; |
||
25 | divf -- manawyrm [label="TDMoIP"]; |
||
26 | divf -- gruetzkopf [label="TDMoIP"]; |
||
27 | divf -- roox [label="TDMoIP"]; |
||
28 | divf -- DrDeke [label="TDMoIP"]; |
||
29 | etc [label="other users..."]; |
||
30 | divf -- etc [label="TDMoIP"]; |
||
31 | } |
||
32 | }} |
||
33 | |||
34 | 15 | laforge | h3. IP network |
35 | |||
36 | {{graphviz_link() |
||
37 | graph G { |
||
38 | subgraph cluster_colo { |
||
39 | label = "Co-Located Hub"; |
||
40 | vlan [label="VLAN/Switch",shape="rect"]; |
||
41 | divf [label="DIVF\nCentral Switch",shape="house"]; |
||
42 | apu [label="APU (hosting icE1usb)"]; |
||
43 | pm3 [label="Livingston Portmaster 3"]; |
||
44 | as54 [label="Cisco AS5400"]; |
||
45 | |||
46 | |||
47 | vlan -- divf; |
||
48 | vlan -- apu; |
||
49 | vlan -- pm3; |
||
50 | vlan -- as54; |
||
51 | } |
||
52 | lakshmi [label="Firewall\n(lakshmi)"]; |
||
53 | public_v4 [label="Internet (IPv4)"]; |
||
54 | public_v6 [label="Internet (IPv6)"]; |
||
55 | 17 | laforge | divf -- lakshmi [label="VLAN 257"]; |
56 | 15 | laforge | lakshmi -- public_v4; |
57 | lakshmi -- public_v6; |
||
58 | } |
||
59 | }} |
||
60 | 1 | laforge | |
61 | 23 | laforge | h2. Pictures |
62 | |||
63 | h3. Rack setup |
||
64 | |||
65 | This picture shows OCTOI hub equipment + some other machines of @laforge: |
||
66 | |||
67 | 24 | laforge | {{thumbnail(octoi_hub-colocated.jpg, size=700)}} |
68 | 23 | laforge | |
69 | h3. GPS antenna |
||
70 | |||
71 | 24 | laforge | {{thumbnail(20220919_130715.jpg, size=400)}} |
72 | 23 | laforge | |
73 | |||
74 | h3. GPS receiver, PSU, OVP |
||
75 | |||
76 | 24 | laforge | {{thumbnail(octoi_hub-gps.jpg, size=500)}} |
77 | 23 | laforge | |
78 | 4 | laforge | h2. Rackmount units |
79 | 1 | laforge | |
80 | 4 | laforge | h3. Central Office server (2U / 67cm) |
81 | 1 | laforge | |
82 | 4 | laforge | This is a 2U rack-mount server running all the relevant software. |
83 | 1 | laforge | |
84 | 4 | laforge | See [[AVSt_Server]] for more details of the server |
85 | 1 | laforge | |
86 | 4 | laforge | h4. Connections |
87 | 1 | laforge | |
88 | 4 | laforge | This is a 2U rack-mount server with the following connections: |
89 | * Power |
||
90 | 10 | laforge | ** 2x AC power connections (redundant PSU) |
91 | 4 | laforge | * Ethernet |
92 | ** 1x RJ45 100-Base-TX BMC |
||
93 | ** 2x RJ45 1000-Base-TX |
||
94 | * E1 |
||
95 | 20 | laforge | ** 87 E1 to a co-located Cisco AS5400 (see below) |
96 | 4 | laforge | ** 1x E1 to a co-located Livingston PM3 (see below) |
97 | ** 1x E1 to icE1usb/clock-source |
||
98 | 20 | laforge | ** 2x E1 used with loop-back cable to provide proper timing from master card to slave card (timing cable has residual clock drift) |
99 | 1 | laforge | |
100 | 4 | laforge | h3. icE1usb / E1 clock source (1U / 31cm) |
101 | 1 | laforge | |
102 | 23 | laforge | |
103 | 4 | laforge | This is a 1U rack mount system containing: |
104 | * a PC-Engines APU3 embedded x86_64 |
||
105 | * an [[e1-t1-adapter:ICE40_E1_USB_interface|icE1usb]] with a custom RS422 interface board |
||
106 | * a custom rs422 over voltage protection + 12V injection board |
||
107 | 1 | laforge | |
108 | This icE1usb acts as a GPS-disciplined clock master. However, as no acutal RF GPS signal is available in the data centre, we are using an Ericsson [[ericsson-rbs-6xxx:GPS_02]] attached via ~100m of RS-422. |
||
109 | 23 | laforge | |
110 | 26 | laforge | {{thumbnail(20220905_205638.jpg, size=500)}} {{thumbnail(20220831_204322.jpg)}} |
111 | 1 | laforge | |
112 | 4 | laforge | h4. Connections |
113 | 1 | laforge | |
114 | 4 | laforge | * Power |
115 | ** 2x AC power connections (1x APU, 1x RS422/GPS) |
||
116 | * Ethernet |
||
117 | 8 | laforge | ** 1x RJ45 to internal VLAN |
118 | 4 | laforge | * RS422 |
119 | 1 | laforge | ** 1x RJ45 towards GPS02 on the roof |
120 | |||
121 | 4 | laforge | h3. Cisco AS5400 RAS Server (2U / 49cm) |
122 | 1 | laforge | |
123 | 4 | laforge | h4. Connections |
124 | 1 | laforge | |
125 | 4 | laforge | * Power |
126 | ** 2x AC power connection (redundant PSU) |
||
127 | * Ethernet |
||
128 | ** 1x RJ45 Ethernet (100-Base-TX) to internal VLAN |
||
129 | * E1 |
||
130 | ** 8x E1 (via break-out cable) to AVSt-Server |
||
131 | 7 | laforge | * RS232 |
132 | ** Serial console connection via USB-UART to [[AVSt_Server]] |
||
133 | 4 | laforge | |
134 | h3. Livingstion Portmaster 3 (2U / 31cm) |
||
135 | |||
136 | h4. Connections |
||
137 | |||
138 | * Power |
||
139 | ** 1x AC power connection |
||
140 | * Ethernet |
||
141 | 9 | laforge | ** 1x RJ45 Ethernet (10-Base-TX) [yes, 10MBps] to internal VLAN |
142 | 4 | laforge | * E1 |
143 | ** 1x E1 to AVSt-Server |
||
144 | 6 | laforge | * RS232 |
145 | ** Serial console connection via USB-UART to [[AVSt_Server]] |
||
146 | 4 | laforge | |
147 | h2. Roof installation |
||
148 | |||
149 | |||
150 | On the roof of the data centre, the CAT5 cable with RS422 for the GPS03 arrives. |
||
151 | |||
152 | It will be passed through several DIN rail mounted OVP (Over Voltage Protection) circuits before connecting to the actual DIN-rail mounted Ericsson GPS03 |
||
153 | |||
154 | The Ericsson GPS03 has a SMA connector, to which a SMA-male to N-Male coaxial cable is attached. |
||
155 | |||
156 | A Times Microwave LP-GTR-NFF lightning protector (N-female to N-femaile) is used to pass the coaxial cable through the enclosure |
||
157 | |||
158 | An external GPS antenna with N connector is plugged into the LP-GTR-NFF |
||
159 | 1 | laforge | |
160 | 5 | laforge | h3. Overview diagram |
161 | 1 | laforge | |
162 | 5 | laforge | This diagram illustrates the parts and connections on the rooftop. Rectangular objects are DIN-rail mounted. |
163 | 1 | laforge | |
164 | 5 | laforge | {{graphviz_link() |
165 | graph G { |
||
166 | subgraph cluster_1 { |
||
167 | label="Rooftop enclosure"; |
||
168 | rj45splitter [label="RJ45 splitter"]; |
||
169 | GPS03 [label="Ericsson GPS03", shape=rect]; |
||
170 | ovp_rs422_1 [shape=rect]; |
||
171 | ovp_rs422_2 [shape=rect]; |
||
172 | ovp_rs422_3 [shape=rect]; |
||
173 | ovp_12v [shape=rect]; |
||
174 | lp [label="LP-GTR-NFF"]; |
||
175 | rj45splitter -- ovp_rs422_1; |
||
176 | rj45splitter -- ovp_rs422_2; |
||
177 | rj45splitter -- ovp_rs422_3; |
||
178 | rj45splitter -- ovp_12v; |
||
179 | ovp_rs422_1 -- GPS03; |
||
180 | ovp_rs422_2 -- GPS03; |
||
181 | ovp_rs422_3 -- GPS03; |
||
182 | ovp_12v -- GPS03; |
||
183 | GPS03 -- lp [label="SMA-male/N-female"]; |
||
184 | } |
||
185 | antenna [label="GPS Antenna"]; |
||
186 | antenna -- lp [label="RG58 white / N-female"]; |
||
187 | rack [label="Rack in DC"]; |
||
188 | rack -- rj45splitter [label="CAT5"]; |
||
189 | } |
||
190 | }} |
||
191 | 2 | laforge | |
192 | 1 | laforge | h2. Software |
193 | |||
194 | 27 | sur5r | * Like in the current hub at @laforge's basement, we should run the entire yate / osmo-e1d / dahdi-trunkdev inside a KVM with SR-IOV mapping the PCI devices |
195 | 3 | laforge | |
196 | 16 | laforge | h2. Network |
197 | |||
198 | h2. Public IP |
||
199 | |||
200 | |_.Host|_.IPv4|_.IPv6|_.IPv4-internal| |
||
201 | |avst|213.95.46.30|?|192.168.7.129/25| |
||
202 | |divf|213.95.46.31|?|192.168.7.130/25| |
||
203 | |as5400|213.95.46.29|?|192.168.7.133| |
||
204 | |pm3|-|-|192.168.7.132| |
||
205 | |icE1-apu|-|-|192.168.7.131| |
||
206 | 21 | laforge | |stats|213.95.46.27|-|192.168.7.134| |
207 | 16 | laforge | |avst-bmc|213.95.46.28|?|-| |
208 | 3 | laforge | |
209 | h2. Misc / TODO |
||
210 | |||
211 | h3. local verification with modem/ISDN-TA |
||
212 | |||
213 | It would be great if we could somehow verify local calls via the yate / hub excluding the complexity of the TDMoIP to compare calls without TDMoIP to calls with TDMoIP. |
||
214 | |||
215 | Unfortuantely I'm not aware of any really small PBX that would terminate the E1/S2M and offer S0/POTS ports. Adding antoher 3U for a PBX seems excessive. |
||
216 | |||
217 | 1 | laforge | Doing calls between PM3 and ASR5400 is of course an option, but ideally we'd have a real physical modem attached via a serial port, and a real HFC-S-USB for test purpose. |
218 | 11 | laforge | |
219 | h2. High-level parameters for data centre |
||
220 | |||
221 | * 7U rackspace |
||
222 | * 7x AC power outlet |
||
223 | 13 | laforge | * 7x Ethernet switch port (one of which supports 10 MBps!) |
224 | 11 | laforge | ** some ports in a new VLAN |
225 | ** some ports in an existing VLAN of my other servers in Rack 1120 |
||
226 | * 1x CAT5 between rack and roof |
||
227 | * about 10cm of space on DIN-rail on roof enclosure (to mount OVP + GPS03) |
||
228 | |||
229 | h2. Questions |
||
230 | 1 | laforge | |
231 | 12 | laforge | * Required antenna cable length between rooftop enclosure and antenna |
232 | * Mechanical antenna mounting details |
||
233 | 11 | laforge | * detailed switch port / VLAN config |