2026-05-26
Selecting...
Home Page
reload
Search in this channel...
Punch card
Raw Text (irssi format)
Fork on github
switch to admin mode
Jump to...
redirecting...
Log for
電訊台
am 12:00:44
survivalmeaningsssss@tg
Facebook 已死
am 12:57:11
ITUE164@tg
Facebook 破產
am 12:57:22
ITUE164@tg
結業
am 01:20:41
sgniteerG
https://www.reddit.com/r/sysadmin/comments/q181fv/looks_like_facebook_is_down/hfd4dyv/?context=3
am 01:21:07
ITUE164@tg
am 01:21:36
ITUE164@tg
結業，正常，俾CY 搞
am 01:22:10
ITUE164@tg
習慣下冇FB 的日子
am 01:23:02
ITUE164@tg
Google 仲末down
am 01:59:14
survivalmeaningsssss@tg
am 01:59:17
survivalmeaningsssss@tg
核爆？
am 01:59:19
survivalmeaningsssss@tg
am 02:38:48
Licson Lee
Facebook 死內部 BGP，搞到 DNS 唔通
am 02:38:59
ʇɹᴉsʞʎ🐕(有狗!) 0️⃣9️⃣:4️⃣2️⃣ PM
.........
am 02:39:01
mysql_real_escape_string@tg
am 02:39:02
Licson Lee
個 DNS 控制晒所有 Facebook 嘅 domain
am 02:39:09
mysql_real_escape_string@tg
點做到
am 02:39:16
Licson Lee
拖死晒全部 service
am 02:39:18
mysql_real_escape_string@tg
佢冇failover咩
am 02:39:32
Licson Lee
應該係內部 BGP 傻咗
am 02:39:35
mysql_real_escape_string@tg
Bgp問題應該唔洗搞咁耐
am 02:39:38
mysql_real_escape_string@tg
am 02:39:42
Licson Lee
唔係
am 02:40:23
Licson Lee
擺 DNS 嘅 IP prefix 似乎因為 BGP 有問題而冇 route
am 02:40:37
Licson Lee
Facebook 自己的內部工具都係
fb.com
到
am 02:40:50
Licson Lee
依家自己人用唔到自己啲 debug tool
am 02:40:53
Licson Lee
am 02:40:55
mysql_real_escape_string@tg
Emm
am 02:41:06
survivalmeaningsssss@tg
am 02:41:29
mysql_real_escape_string@tg
Prtg呢啲都死埋又幾難搞
am 02:41:38
mysql_real_escape_string@tg
點知邊度死左
am 02:41:48
mysql_real_escape_string@tg
am 02:42:32
survivalmeaningsssss@tg
am 02:42:37
survivalmeaningsssss@tg
呢個好笑
am 02:42:39
survivalmeaningsssss@tg
am 02:43:15
Licson Lee
am 02:43:26
Licson Lee
Facebook DNS 原來唔係自己個 network 到
am 02:44:02
Licson Lee
睇錯咗
am 02:45:18
Licson Lee
am 02:45:25
Licson Lee
去到美國先出事
am 02:45:37
Licson Lee
係內部 BGP 問題
am 02:46:17
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
點看內部
am 02:46:47
Licson Lee
hop 8 已經係 Prinville
am 02:46:51
mysql_real_escape_string@tg
am 02:47:00
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
am 02:47:03
Licson Lee
即係 Facebook 個數據中心
am 02:47:20
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
am 02:47:22
Licson Lee
跟住打後都係 DC 內部嘢
am 02:47:25
mysql_real_escape_string@tg
但有乜奶油recover唔到
am 02:47:28
mysql_real_escape_string@tg
am 02:47:47
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
系米甘簡單
am 02:47:52
Licson Lee
搞瓜埋啲內部 system 喎
am 02:47:54
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
rollback
am 02:48:21
mysql_real_escape_string@tg
唔知呀公司慣左有out of band 入得返去
am 02:48:25
Licson Lee
同埋聽聞現場掂到 router 果個唔識整
識整個班又掂唔到 router
am 02:48:39
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
炒得
am 02:48:49
mysql_real_escape_string@tg
想像唔到點死到可以整咁耐都搞唔掂同炒左個dns條route
am 02:49:08
mysql_real_escape_string@tg
唔係應該有dr site同backup route咩
am 02:49:11
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
我收到風今日FB 全部interview唔到
am 02:49:14
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
am 02:49:16
Licson Lee
規模大嘅時候係會複雜啲
am 02:49:19
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
好撚搞笑
am 02:49:21
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
成件事
am 02:49:23
mysql_real_escape_string@tg
am 02:49:49
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
乜9 domain都死哂
am 02:50:29
Licson Lee
Facebook 個 DC network 都係數一數二複雜，同 Google 差唔多
am 02:54:48
ソ瑠璃(soruly)
可能有d router唔係facebook自己控制倒所以搞咁耐
am 02:56:01
ソ瑠璃(soruly)
am 02:56:50
mysql_real_escape_string@tg
am 02:58:16
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
最尾又系5知邊個多手搞過d config來
am 03:14:11
ʇɹᴉsʞʎ🐕(有狗!) 0️⃣9️⃣:4️⃣2️⃣ PM
JUST IN - Facebook employees reportedly can't enter buildings to evaluate the Internet outage because their door access badges don't work anymore (NYT)
@disclosetv
am 03:14:12
ʇɹᴉsʞʎ🐕(有狗!) 0️⃣9️⃣:4️⃣2️⃣ PM
am 03:16:29
ソ瑠璃(soruly)
login with facebook🤪
am 03:17:44
ʇɹᴉsʞʎ🐕(有狗!) 0️⃣9️⃣:4️⃣2️⃣ PM
am 03:18:31
mic4126
am 07:55:59
Mark
… video conference 呢😗
am 09:11:59
彼得 (純粹鳩噏切勿盡信)
😂
am 09:12:17
彼得 (純粹鳩噏切勿盡信)
典型嘅大公司😂
am 09:15:23
Stefan | ᕕ(◠ڼ◠)ᕗ
爆炸啊
am 09:16:11
Stefan | ᕕ(◠ڼ◠)ᕗ
爽
am 09:57:18
Class 168 Clubman 🚂 壽司郎 (Taskmaster)
https://blog.cloudflare.com/october-2021-facebook-outage/
am 10:20:42
mysql_real_escape_string@tg
嘩真bgp死🤔
am 11:20:06
winnethepool@tg
all route Deleted 😝
am 11:37:14
彼得 (純粹鳩噏切勿盡信)
am 11:38:07
彼得 (純粹鳩噏切勿盡信)
pm 12:21:13
Stefan | ᕕ(◠ڼ◠)ᕗ
陰毛論：某個intern仔唔小心del咗
pm 12:22:10
Class 168 Clubman 🚂 壽司郎 (Taskmaster)
Internship during Oct?
pm 12:22:55
ricebowl
intern仔咁高level權限？
pm 01:26:31
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
As expected:
faulty configuration change
pm 01:26:48
Yz167BmhcdhHYMCdeqlv4MHalHhXkqsk@tg
真系有人手多
pm 01:29:06
彼得 (純粹鳩噏切勿盡信)
pm 02:44:58
Licson Lee
好似係 automated system 嘅問題嚟
pm 02:45:12
Licson Lee
auto fix 咗個 config，但係 fix 錯咗
pm 02:57:05
ITUE164@tg
https://hd.stheadline.com/news/realtime/hk/2250067/%E5%8D%B3%E6%99%82-%E6%B8%AF%E8%81%9E-%E7%8D%A8%E5%AE%B6-%E6%B8%AF%E7%A0%94-%E7%B6%B2%E7%B5%A1%E5%AE%89%E5%85%A8%E6%B3%95-%E8%A8%82%E6%95%B8%E6%93%9A%E4%BF%9D%E9%9A%9C%E6%BA%96%E5%89%87
pm 03:01:48
ITUE164@tg
GFW is coming to HK
pm 03:27:22
ITUE164@tg
pm 03:36:38
sib_der_man@tg
pm 04:02:04
winnethepool@tg
pm 08:23:39
survivalmeaningsssss@tg
有冇嘢搞
created by
mmis1000
and release under
MIT License
GitHub Repo