Colocated Hub » History » Version 23
laforge, 09/29/2022 06:46 PM
1 | 2 | laforge | {{>toc}} |
---|---|---|---|
2 | |||
3 | 1 | laforge | h1. Colocated Hub |
4 | |||
5 | 22 | laforge | This page existed to collect information about the new (Sept 2022) colocated OCTOI hub, see #5542 |
6 | |||
7 | 2 | laforge | |
8 | 14 | laforge | h2. Block Diagrams |
9 | |||
10 | h3. E1/TDM network |
||
11 | |||
12 | {{graphviz_link() |
||
13 | graph G { |
||
14 | subgraph cluster_colo { |
||
15 | label = "Co-Located Hub"; |
||
16 | divf [label="DIVF\nCentral Switch",shape="house"]; |
||
17 | icE1usb; |
||
18 | pm3 [label="Livingston Portmaster 3"]; |
||
19 | as54 [label="Cisco AS5400"]; |
||
20 | icE1usb -- divf [label="E1 (timing master)"]; |
||
21 | pm3 -- divf [label="E1"]; |
||
22 | 20 | laforge | as54 -- divf [label="7xE1"]; |
23 | 14 | laforge | } |
24 | divf -- laforge [label="TDMoIP"]; |
||
25 | divf -- manawyrm [label="TDMoIP"]; |
||
26 | divf -- gruetzkopf [label="TDMoIP"]; |
||
27 | divf -- roox [label="TDMoIP"]; |
||
28 | divf -- DrDeke [label="TDMoIP"]; |
||
29 | etc [label="other users..."]; |
||
30 | divf -- etc [label="TDMoIP"]; |
||
31 | } |
||
32 | }} |
||
33 | |||
34 | 15 | laforge | h3. IP network |
35 | |||
36 | {{graphviz_link() |
||
37 | graph G { |
||
38 | subgraph cluster_colo { |
||
39 | label = "Co-Located Hub"; |
||
40 | vlan [label="VLAN/Switch",shape="rect"]; |
||
41 | divf [label="DIVF\nCentral Switch",shape="house"]; |
||
42 | apu [label="APU (hosting icE1usb)"]; |
||
43 | pm3 [label="Livingston Portmaster 3"]; |
||
44 | as54 [label="Cisco AS5400"]; |
||
45 | |||
46 | |||
47 | vlan -- divf; |
||
48 | vlan -- apu; |
||
49 | vlan -- pm3; |
||
50 | vlan -- as54; |
||
51 | } |
||
52 | lakshmi [label="Firewall\n(lakshmi)"]; |
||
53 | public_v4 [label="Internet (IPv4)"]; |
||
54 | public_v6 [label="Internet (IPv6)"]; |
||
55 | 17 | laforge | divf -- lakshmi [label="VLAN 257"]; |
56 | 15 | laforge | lakshmi -- public_v4; |
57 | lakshmi -- public_v6; |
||
58 | } |
||
59 | }} |
||
60 | 1 | laforge | |
61 | 23 | laforge | h2. Pictures |
62 | |||
63 | h3. Rack setup |
||
64 | |||
65 | This picture shows OCTOI hub equipment + some other machines of @laforge: |
||
66 | |||
67 | {{thumbnail(octoi_hub-colocated.jpg, size=400)}} |
||
68 | |||
69 | h3. GPS antenna |
||
70 | |||
71 | {{thumbnail(20220919_130715.jpg)}} |
||
72 | |||
73 | |||
74 | h3. GPS receiver, PSU, OVP |
||
75 | |||
76 | {{thumbnail(octoi_hub-gps.jpg)}} |
||
77 | |||
78 | 4 | laforge | h2. Rackmount units |
79 | 1 | laforge | |
80 | 4 | laforge | h3. Central Office server (2U / 67cm) |
81 | 1 | laforge | |
82 | 4 | laforge | This is a 2U rack-mount server running all the relevant software. |
83 | 1 | laforge | |
84 | 4 | laforge | See [[AVSt_Server]] for more details of the server |
85 | 1 | laforge | |
86 | 4 | laforge | h4. Connections |
87 | 1 | laforge | |
88 | 4 | laforge | This is a 2U rack-mount server with the following connections: |
89 | * Power |
||
90 | 10 | laforge | ** 2x AC power connections (redundant PSU) |
91 | 4 | laforge | * Ethernet |
92 | ** 1x RJ45 100-Base-TX BMC |
||
93 | ** 2x RJ45 1000-Base-TX |
||
94 | * E1 |
||
95 | 20 | laforge | ** 87 E1 to a co-located Cisco AS5400 (see below) |
96 | 4 | laforge | ** 1x E1 to a co-located Livingston PM3 (see below) |
97 | ** 1x E1 to icE1usb/clock-source |
||
98 | 20 | laforge | ** 2x E1 used with loop-back cable to provide proper timing from master card to slave card (timing cable has residual clock drift) |
99 | 1 | laforge | |
100 | |||
101 | 4 | laforge | h3. icE1usb / E1 clock source (1U / 31cm) |
102 | 1 | laforge | |
103 | 23 | laforge | |
104 | 4 | laforge | This is a 1U rack mount system containing: |
105 | * a PC-Engines APU3 embedded x86_64 |
||
106 | * an [[e1-t1-adapter:ICE40_E1_USB_interface|icE1usb]] with a custom RS422 interface board |
||
107 | * a custom rs422 over voltage protection + 12V injection board |
||
108 | 1 | laforge | |
109 | This icE1usb acts as a GPS-disciplined clock master. However, as no acutal RF GPS signal is available in the data centre, we are using an Ericsson [[ericsson-rbs-6xxx:GPS_02]] attached via ~100m of RS-422. |
||
110 | 23 | laforge | |
111 | {{thumbnail(20220905_205638.jpg)}} |
||
112 | |||
113 | {{thunbnail(20220831_204322.jpg)}} |
||
114 | 1 | laforge | |
115 | 4 | laforge | h4. Connections |
116 | 1 | laforge | |
117 | 4 | laforge | * Power |
118 | ** 2x AC power connections (1x APU, 1x RS422/GPS) |
||
119 | * Ethernet |
||
120 | 8 | laforge | ** 1x RJ45 to internal VLAN |
121 | 4 | laforge | * RS422 |
122 | 1 | laforge | ** 1x RJ45 towards GPS02 on the roof |
123 | |||
124 | 4 | laforge | h3. Cisco AS5400 RAS Server (2U / 49cm) |
125 | 1 | laforge | |
126 | 4 | laforge | h4. Connections |
127 | 1 | laforge | |
128 | 4 | laforge | * Power |
129 | ** 2x AC power connection (redundant PSU) |
||
130 | * Ethernet |
||
131 | ** 1x RJ45 Ethernet (100-Base-TX) to internal VLAN |
||
132 | * E1 |
||
133 | ** 8x E1 (via break-out cable) to AVSt-Server |
||
134 | 7 | laforge | * RS232 |
135 | ** Serial console connection via USB-UART to [[AVSt_Server]] |
||
136 | 4 | laforge | |
137 | h3. Livingstion Portmaster 3 (2U / 31cm) |
||
138 | |||
139 | h4. Connections |
||
140 | |||
141 | * Power |
||
142 | ** 1x AC power connection |
||
143 | * Ethernet |
||
144 | 9 | laforge | ** 1x RJ45 Ethernet (10-Base-TX) [yes, 10MBps] to internal VLAN |
145 | 4 | laforge | * E1 |
146 | ** 1x E1 to AVSt-Server |
||
147 | 6 | laforge | * RS232 |
148 | ** Serial console connection via USB-UART to [[AVSt_Server]] |
||
149 | 4 | laforge | |
150 | h2. Roof installation |
||
151 | |||
152 | |||
153 | On the roof of the data centre, the CAT5 cable with RS422 for the GPS03 arrives. |
||
154 | |||
155 | It will be passed through several DIN rail mounted OVP (Over Voltage Protection) circuits before connecting to the actual DIN-rail mounted Ericsson GPS03 |
||
156 | |||
157 | The Ericsson GPS03 has a SMA connector, to which a SMA-male to N-Male coaxial cable is attached. |
||
158 | |||
159 | A Times Microwave LP-GTR-NFF lightning protector (N-female to N-femaile) is used to pass the coaxial cable through the enclosure |
||
160 | |||
161 | An external GPS antenna with N connector is plugged into the LP-GTR-NFF |
||
162 | 1 | laforge | |
163 | 5 | laforge | h3. Overview diagram |
164 | 1 | laforge | |
165 | 5 | laforge | This diagram illustrates the parts and connections on the rooftop. Rectangular objects are DIN-rail mounted. |
166 | 1 | laforge | |
167 | 5 | laforge | {{graphviz_link() |
168 | graph G { |
||
169 | subgraph cluster_1 { |
||
170 | label="Rooftop enclosure"; |
||
171 | rj45splitter [label="RJ45 splitter"]; |
||
172 | GPS03 [label="Ericsson GPS03", shape=rect]; |
||
173 | ovp_rs422_1 [shape=rect]; |
||
174 | ovp_rs422_2 [shape=rect]; |
||
175 | ovp_rs422_3 [shape=rect]; |
||
176 | ovp_12v [shape=rect]; |
||
177 | lp [label="LP-GTR-NFF"]; |
||
178 | rj45splitter -- ovp_rs422_1; |
||
179 | rj45splitter -- ovp_rs422_2; |
||
180 | rj45splitter -- ovp_rs422_3; |
||
181 | rj45splitter -- ovp_12v; |
||
182 | ovp_rs422_1 -- GPS03; |
||
183 | ovp_rs422_2 -- GPS03; |
||
184 | ovp_rs422_3 -- GPS03; |
||
185 | ovp_12v -- GPS03; |
||
186 | GPS03 -- lp [label="SMA-male/N-female"]; |
||
187 | } |
||
188 | antenna [label="GPS Antenna"]; |
||
189 | antenna -- lp [label="RG58 white / N-female"]; |
||
190 | rack [label="Rack in DC"]; |
||
191 | rack -- rj45splitter [label="CAT5"]; |
||
192 | } |
||
193 | }} |
||
194 | 2 | laforge | |
195 | 1 | laforge | h2. Software |
196 | |||
197 | 3 | laforge | * Like in the current hub at @laforge's basement, we should run the entire yate / osmo-e1d / dahdi-trunkdev inside a KVM with SRV-IO mapping the PCI devices |
198 | |||
199 | 16 | laforge | h2. Network |
200 | |||
201 | h2. Public IP |
||
202 | |||
203 | |_.Host|_.IPv4|_.IPv6|_.IPv4-internal| |
||
204 | |avst|213.95.46.30|?|192.168.7.129/25| |
||
205 | |divf|213.95.46.31|?|192.168.7.130/25| |
||
206 | |as5400|213.95.46.29|?|192.168.7.133| |
||
207 | |pm3|-|-|192.168.7.132| |
||
208 | |icE1-apu|-|-|192.168.7.131| |
||
209 | 21 | laforge | |stats|213.95.46.27|-|192.168.7.134| |
210 | 16 | laforge | |avst-bmc|213.95.46.28|?|-| |
211 | 3 | laforge | |
212 | h2. Misc / TODO |
||
213 | |||
214 | h3. local verification with modem/ISDN-TA |
||
215 | |||
216 | It would be great if we could somehow verify local calls via the yate / hub excluding the complexity of the TDMoIP to compare calls without TDMoIP to calls with TDMoIP. |
||
217 | |||
218 | Unfortuantely I'm not aware of any really small PBX that would terminate the E1/S2M and offer S0/POTS ports. Adding antoher 3U for a PBX seems excessive. |
||
219 | |||
220 | 1 | laforge | Doing calls between PM3 and ASR5400 is of course an option, but ideally we'd have a real physical modem attached via a serial port, and a real HFC-S-USB for test purpose. |
221 | 11 | laforge | |
222 | h2. High-level parameters for data centre |
||
223 | |||
224 | * 7U rackspace |
||
225 | * 7x AC power outlet |
||
226 | 13 | laforge | * 7x Ethernet switch port (one of which supports 10 MBps!) |
227 | 11 | laforge | ** some ports in a new VLAN |
228 | ** some ports in an existing VLAN of my other servers in Rack 1120 |
||
229 | * 1x CAT5 between rack and roof |
||
230 | * about 10cm of space on DIN-rail on roof enclosure (to mount OVP + GPS03) |
||
231 | |||
232 | h2. Questions |
||
233 | 1 | laforge | |
234 | 12 | laforge | * Required antenna cable length between rooftop enclosure and antenna |
235 | * Mechanical antenna mounting details |
||
236 | 11 | laforge | * detailed switch port / VLAN config |