Peering Information: Some Data Points William B. Norton

Peering Information: Some Data Points William B. Norton

Peering Information: Some Data Points William B. Norton Co-Founder and Chief Technical Liaison Equinix, Inc. NSFNET to Post-NSFNET Era Internet NSFNET (1987-1994) Regional Tech Meetings NWNet OarNet NSFNET Regional Sesqui SDSC Routing & Network Planning NCAR OarNet NWNet Privatization (1994-Now) North American Network Operators Group (NANOG) Meetings NyserNet NEARNet BARRNet Performance & Operations Regional Reporting & Coordination Merit Regional Merit ANS NyserNet UUNet Sprint MCI AT&T Regional Regional Regional Regional Mom, C. No Internet Preso Internet Statistics 87.5% of all Internet statistics are made up. Made Up Real Source: Source: I made

it up I made it up. My Job Now 1. Bad Jokes in Public Forums 2. Internet Operations Research 3. Present Findings in Forums ITU Rio de Janeiro RIPE Budapest NANOG Montreal, Eugene ISPCon - * IIR London Inet Prague, Yokohama APRICOT Manila, Singapore, Seoul, Kuala Lumpur INTAP - Tokyo IETF Oslo FCC Washington DC ITW Seattle Cisco Forum, CLEC Expo, IWS2000 Tskuba, Etc. Audience Internet Service Providers and Peering 200 ISP Peering Coordinators Terminology, strategies, Process, thought pattern One of the Most Difficult Parts of Peering is Initiating Contact (who, how, initiating dialog) So, at Montreal NANOG Peering BOF presented white paper Introduced Peering Contact Database Only for Peering Coordinators Toss in business card (w/AS#) All those in PCD get e-mailed updated PCD 130 Peering Coordinators listed today I evangelize the PCD during my talks Full Peering Contact Database Notes: Version 3.0 Listing does not imply will Updates:[email protected] peer Depricated Updated Company AS Number 18-May-00 AboveNet UK Ltd 27-Oct-00 adelphia 27-Oct-00 adelphia business solutions First Name Last Name http://www.above.net/ Asquith

Bonaparte 7843 [email protected] www.adelphia.net dave bernardi www.adelphia-abs.net dave bernardi http://www.adelphia.net Joseph Klein www.aduronet.com Nic Lewis 15441 [email protected] 24-Oct-00 Advanced TelCom Group 6977 [email protected] www.CallATG.com John Harkin 16-Dec-99 AiNET 6405 [email protected] http://www.ai.net Deepak Jain 12222 [email protected] www.akamai.com Sean Butler 11466 [email protected] http://www.allegiancetelecom.com W illiam Charnock www.alt.net http://www.aol.com Chris

Caputo 18-May-00 Akamai 16-Jun-00 Allegiance Telecom, Inc 29-Nov-99 Altopia Corporation 18-Dec-00 America Online xxxxx web URL 6461 [email protected] 18756 [email protected] 1-Feb-01 Adephia Business Solutions18756, 19548 [email protected] 22-Oct-00 Aduronet 5/11/2001 Who threw in the card? --> PEERING CONTACT DATABASE E-mail @ for Peering 6456 [email protected] 1668 [email protected] 16-Dec-99 AmericanISP, LLC. 14150 [email protected] http://www.americanisp.net Brad Baker 15-Nov-99 AppliedTheory Corporation 24-Oct-00 Atom Films 1785 [email protected] 16841 [email protected] www.appliedtheory.com www.atomfilms.com Jim Aaron Shaffer Moreau-Cook http://www.ispau.net Michael Dillon http://www.bbc.co.uk/ James Rice http://www.bellnexxia.com/ Erone

Quek http://www.bbc.co.uk/ Simon Lockhart 6395 [email protected] http://www.broadwing.com Tonya Small 22-Oct-00 Broadwing Communications 6395 [email protected] www.broadwing.com Joe Payne 24-Oct-00 Broadwing Communications 6395 [email protected] 18-Oct-99 Austel Inc. 23-Jan-01 BBC Internet Services 4752 [email protected] 2818, 9156 18-Oct-99 Bell Nexxia 9156(US) 18-Oct-99 British Broadcasting Corporation 2818(UK) 20-May-00 Broadwing (Formerly IXC) [email protected] 577 [email protected] [email protected] www.broadwing.com Brad Neal 8404 [email protected] 3491 [email protected] 8918 [email protected] http://cais.com www.carrier1.com Patrick Matt Ren Schaller Chrosniak Nowlin 24-Oct-00 Carrier1 18-Oct-99 Circle Net, Inc.

8918 [email protected] 7938 [email protected] www.carrier1.com http://www.circle.net/ Chris Troy Cousins Arie Cobb 18-Oct-99 CiteNet Telecom Inc. 4470 [email protected] http://www.citenet.net/ Michael Moscovitch 18-May-00 Cablecom Media AG 26-Apr-01 CAIS Internet 23-Mar-01 Carrier1 Current PCD Listings Demographics of the Peering Contact Database Peering Contact Database Asia/Pacific North America Europe Bill's Speaking Gigs Asia/Pacific North America Europe Survey 2001: Study of Global IX Populations Surveyed All exchange points in the world Copied All participants information Midway through 2000 Competitive Intelligence Report Below are the major exchange points and their corresponding customer contact information Version 0.1 12/28/99 Snapshot at year end 1999 wbn: Initial pass at the list of exchanges and Toronto Internet Exchange, PAIX customers listed, MAE-West, MAE-East, MAE-LA, MAE-Houston, MAE-Dallas wbn: Added Europe, AP, South American, Middle East and African Exchanges from http://www.ep.net Need: MAE-West Company info filled out, PAIX Customers City & State filled in Need: Sort through ISPs and combine information to fill in holes (PAIX vs. MAE-East) Need: Check with Dean Witter Report - Do we have all exchanges? Need: Fix broken links Assumption: Those who attach to exchanges today are prime target candidates for Equinix Need: Add the participant list for each exchange Need: AS lookup using whois Note: No easy update method for this info Note: We are missing many emerging exchanges (S&D, InterNAP, NetRail space) Assumption: Data is relatively static since ISPs rarely leave exchange

All Known Exchange Points WorldRegion ExchangeCountry South America Chile Asia/Pacific Korea Europe Rome North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA North America USA Cregion ExchangeState/Territory City Southern West Coast MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest MidWest Alaska Illinois

Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Illinois Anchorage Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Chicago Hypertext URL for Exchange Point A members only exchange in Chile A Private Korean Exchange (Korean) AIX - Athens Internet Exchange AMAP - An Exchange in Anchorage Alaska Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info

Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Ameritech NAP info Combining contact info From multiple exchanges Gives a better view of Potential contact points 2001 North American Exchange Points Exchange Customers--> WorldRegion ExchangeCountry Cregion NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica

US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US NorthAmerica US ExchangeState/Territory City WestCoastMoffitt Field WestCoastAnchorage MiddleAmerica Chicago

MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica

Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago MiddleAmerica Chicago Started with ep.net and expanded into other publicly available information CA Alaska IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL

IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL IL Hypertext URL for Exchange Point Exchange Company Service name: (C,DF,ISP) Attachment PNETS LicNo AIX - Ames Internet Exchange AMAP - Anchorage Metropolitan Access Point"> Ameritech NAP info (Chicago NAP) @home Network OC12c / 2 x OC3c ATM) Ameritech NAP info (Chicago NAP) Above.Net OC3c ATM) Ameritech NAP info (Chicago NAP) ACSI DS3 ATM) Ameritech NAP info (Chicago NAP) Advantis/IBM Global Networks OC3c and DS3 ATM) Ameritech NAP info (Chicago NAP) AGIS OC3c ATM) Ameritech NAP info (Chicago NAP) Akamai Technologies OC3c) Ameritech NAP info (Chicago NAP) Alpha Net OC3c ATM) Ameritech NAP info (Chicago NAP) American Information Systems, OC3c Inc.ATM) Ameritech NAP info (Chicago NAP) Ameritech Corp. OC3c ATM) Ameritech NAP info (Chicago NAP) Ameritech.net OC3c ATM) Ameritech NAP info (Chicago NAP) Argonne National Laboratory OC3c ATM)* Ameritech NAP info (Chicago NAP) AT&T Worldnet OC3c ATM) Ameritech NAP info (Chicago NAP)

BBN Planet OC12c/ 2 x OC3c ATM) Ameritech NAP info (Chicago NAP) Broadwing OC3c ATM) Ameritech NAP info (Chicago NAP) Cable and Wireless 3 x DS3 ATM) Ameritech NAP info (Chicago NAP) CAIS Internet OC3c ATM) Ameritech NAP info (Chicago NAP) Canarie OC3c ATM)** Ameritech NAP info (Chicago NAP) Carrier1 OC3c ATM) Ameritech NAP info (Chicago NAP) Cetlink OC3c ATM) Ameritech NAP info (Chicago NAP) Chorus Networks OC3c ATM) Ameritech NAP info (Chicago NAP) ClearData OC3c ATM) Ameritech NAP info (Chicago NAP) Cogent OC12c ATM) Ameritech NAP info (Chicago NAP) Com Net Communications System DS3 ATM) Inc. Ameritech NAP info (Chicago NAP) Comdisco OC3c ATM) Ameritech NAP info (Chicago NAP) CommuniTech.Net, Inc. DS3 ATM) Ameritech NAP info (Chicago NAP) ConXioN OC12c ATM) Ameritech NAP info (Chicago NAP) Corecomm OC3c ATM) Ameritech NAP info (Chicago NAP) CRL Network Services DS3 ATM) Ameritech NAP info (Chicago NAP) Data Research Associates DS3 ATM) Ameritech NAP info (Chicago NAP) DefenseResearchEducationNetwork OC3c ATM)* Ameritech NAP info (Chicago NAP) Demon Internet DS3 ATM) Ameritech NAP info (Chicago NAP) Deutsche Telecom OC3c) Ameritech NAP info (Chicago NAP) Digex DS3/OC3c ATM) Ameritech NAP info (Chicago NAP) Digital Island OC3c ATM) Ameritech NAP info (Chicago NAP) DSL.net, Inc. / Tycho Networks OC3c ATM) Ameritech NAP info (Chicago NAP) Electric Lightwave DS3 ATM)

Ameritech NAP info (Chicago NAP) EnterAct Corp. OC3c ATM) Ameritech NAP info (Chicago NAP) Epoch Networks/HLC InternetDS3 ATM) Ameritech NAP info (Chicago NAP) ESnet OC3c ATM)* Ameritech NAP info (Chicago NAP) Exodus 3 x OC3c ATM) Ameritech NAP info (Chicago NAP) Fermi National Laboratory OC3c ATM)* Ameritech NAP info (Chicago NAP) Fiber Network Solutions OC3c ATM) Ameritech NAP info (Chicago NAP) Frontier GlobalCenter OC3c/DS3 ATM) Ameritech NAP info (Chicago NAP) Genuity DS3 ATM) Ameritech NAP info (Chicago NAP) Globix OC3c ATM) Ameritech NAP info (Chicago NAP) GoodNet OC3c ATM) Ameritech NAP info (Chicago NAP) GSTworld OC3c ATM) Ameritech NAP info (Chicago NAP) Harvey Library DS3 ATM) Ameritech NAP info (Chicago NAP) ICG Telecom OC3c) Ameritech NAP info (Chicago NAP) Iconnet DS3 ATM) Ameritech NAP info (Chicago NAP) IDT DS3 ATM) Ameritech NAP info (Chicago NAP) Illinois State Board of Education OC12c ATM) Ameritech NAP info (Chicago NAP) Indiana University DS3 ATM)* Preliminary Findings Some Peering Contacts are more than 2 Peering Coordinators out of date Discovered best practices of Exchange Point Operators Web Sites Many dont have participants lists Highly variable types of info at exchanges European exchanges tend to be have better web sites for ISP Peering Coordinator usage Best Exchange Point Web Site in the World Clearly understands the information needs of the ISP Peering Coordinator Telcos Names, sales contacts, phone #s and e-mail Participating ISPs Names, peering contacts, phone #s and e-mail Crisp Layout

Recent additions to the Internet Service Providers and Peering White Paper Last Version 3 Stages of Peering: Selection of Peering Partners Initial Contact / Peering Negotiations Peering Implementation Top 5 Reasons NOT to peer Top 5 Reasons not to Peer 1) Already get Traffic for free (through existing peering relationships) Yahoo! Transit $$$ Transit ISP EXODUS Peering $ AOL Top 5 Reasons not to Peer 2) Not True Peers Traffic inequity Huge investment in Ints circuits, 100s of routers and colo sites, Staff installs, peering negotiations, Millions of customers, etc. Large Global Network Provider Scale inequity Not even investments in infrastructure Form: I dont want to haul your traffic around the globe Small Regional Player Top 5 Reasons Not to Peer 3) Lack of Technical Competence Troubleshooting network problems takes longer when the other ISP NOC and engineers lack the technical expertise during an outage Top 5 Reasons Not to Peer 4) Transit Sales Preferred We rather sell you transitLet me introduce you to our sales guys Top 5 Reasons Not to Peer 5) BGP is Tough BGP? No ExpertiseNo measurements No Justification to hire expertsBGP? Simple

Transit Service ISP A Conceptual Hurdle Upstream Upstream Upstream Upstream Transit Transit Transit Transit Providers Provider Provider Provider I N T E R N E T N E T W O R K S Primary Transit Service ISP A Complex Conceptual Hurdle Upstream Upstream Upstream Upstream Transit Transit Transit Transit Providers Provider Provider Provider Backup Transit I N T E R N E T N

E T W O R K S Backup Primary Transit Transit ISP A Seek transport Interconnection $ x $$$ Transit ISP ISP B Transit $$$ 6: personality Top 5 Reasons Not To Peer 5+ Personality Clashes: They dont understand each other and they dont like the interaction Thank you for coming: Main Points 1. Survey 2001 Contact Info out of date 2. Peering Contact Database Send e-mail to [email protected] to get listed 3. Resources Available to the Peering Coordinator Community Resources: Internet Operations Research White Papers Interconnection Strategies for ISPs Internet Service Providers and Peering Peering: Cost Savings Strategies for ISPs draft Peering Simulation Game draft Build vs. Buy Internet Datacenter draft Send e-mail for the Peering Contact Database Send e-mail to [email protected] White Paper: Interconnection Strategies for ISPs Direct circuits replaced with: OC-12 into Exchange Fiber cross connects Cost Comparison of Interconnection Strategies S

S S S G G G G OC-12 S OC-12 G $400,000 Cost Drivers: OC-12 U U U U U Big OC-12 Direct Circuit Cheap Fiber Cross Connects OC-12 A A A A A Aggregation Efficiency over OC-12 (2:1,3:1) OC-12 C C C C Rack Fees C Exchange Model Cost Formula: ExchangeModelCost=BigDirectCircuit()+(n-1)*x/2+RackFees() Monthly Cost of Interconnection $350,000 $300,000 $250,000 $200,000 $150,000 $100,000 $50,000 64 61 58 55 52

49 46 43 40 37 34 31 28 25 22 19 16 13 10 7 4 1 $- # of participants OC-12 $23,000/mo XC=$200/mo Rack=$1500/momo XC=$200/mo XC=$200/mo Rack=$1500/momo Rack=$1500/mo XC=$200/mo Rack=$1500/mo mo So does the Exchange-based model make sense? White Paper: Internet Service Providers Transit & Peering Facilities Allocation 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% Facility fills Facility becomes widely known Critical mass is achieved Bulk selling of rack 10-packs Cross connect revenue grows rapidly First Carrier First ISP(s) First CP(s) ISP A Large Facility

Scaling Transit ISP Secondary Carrier(s) Multiple ISPs provide CP redundancy The Startup Hump ISP B Transit Peering $$ Time Peering WestNet Routing Table $$ USNet EastNet White Paper: Peering: Cost Savings Strategies for ISPs Transit vs. Peering Alternatives $3,500 $/Mbps Exchanged Initial Cost=f(Access,Rack,Port) $3,000 Cost per Mbps Introducing: ISP Peering Breakeven Analysis Graphs TRANSIT IBXCustsGig $2,500 $2,000 $1,500 $1,000 $500 Cost of Transit Exchange Cost of Traffic Exchange in Peering Relationship Number of Mbps exchanged Effective Peering Bandwidth min(Access +Port ) MAX MAX) Number of 10 Mbps 101

91 81 71 61 51 41 31 21 1 Breakeven Point FeEffective Peering BW=100Mbps Cost 155Mbps/100Mbps=$X/Mbps (ISPs Indifferent between GeEffective Peering BW=155Mbps Peering and Transit Cost 155Mbps/1000Mbps=$Y/Mbps traffic exchange) Peering Prefer Peering Expansion Risk at 11 $0 Allocated across the useful capacity at the exchange XODS3 XOOC3 XOOC12 Telseon GigE XOOC48 MAE-East OC-3 MAE-East OC-12 White Paper: The Peering Simulation Game Transit Provider X A A A A A B IXN A B A B

B A XA IXW YC 3,6, 3, ABrolls A 5, rolls Crolls rolls X D rolls 1, Pays TransitCan on others squares (3*$1000) get to IXE Attaches to IXW Can get to IXW, IXS IXE Receives revenue on 6 squares (6*$2000) PaysPays Transit on others squares (8*$1000) Late entrant heading to IXE Transit on others squares (13*$1000) Pays $12,000 Transit on others =squares (11*$1000) Y -revenue $3,000 $9,000 Receives revenue on 4 squares (4*$2000) Pays Transit on others

(17*$1000) Receives onsquares 9 squares (9*$2000) Receives revenue on 4 squares (7*$2000) $8,000 - $8,000 = $0= $5,000 Receives revenue 4 squares (2*$2000) $18,000 -on $13,000 $14,000 - $11,000 = $3,000 $2,000to-peer $17,000 Wants with =C-$15,000 split costs? YES: -$1,000 + both lose a turn Neither has to pay transit to each other! C C C C IXS C Transit Provider Y C C D D White Paper: Build Vs. Buy Internet DataCenter Modeling: When does it make sense to build your own? To Outsource? Issues to consider Economies of Scale? Multiple Business Models

Recently Viewed Presentations

  • Collision Theory - Endeavor Charter School

    Collision Theory - Endeavor Charter School

    Collision Theory This theory states that reactions will occur only if atoms/ molecules within the two (or more) substances "collide". In other words, touch each other! Therefore, if you want to speed up a rxn, you need to collide particles...
  • Style, Tone, and Mood

    Style, Tone, and Mood

    As we watch the movie be sure to write down the mood and tone, but include lots of evidence to prove your point. For example if the mood is cheerful, explain why. Maybe there are flowers everywhere and the sun...
  • Parallel Data Cube F or d B y

    Parallel Data Cube F or d B y

    Parallel Data Cube Data Mining OLAP (On-line analytical processing) cube / group-by operator in SQL Data Warehousing for Decision Support Operational data collected into DW DW used to support multi-dimensional views Views form the basis of OLAP processing Our focus:...
  • The Gift of the Magi - mwalshenglish.weebly.com

    The Gift of the Magi - mwalshenglish.weebly.com

    The Gift of the Magi (b) Explain the role of irony in this literary work. 2. (a) Which details in the story make its surprise ending seem like a logical outcome of events? (b) Why do you think surprise endings...
  • Elie Wiesel - Language Arts

    Elie Wiesel - Language Arts

    Elie Wiesel (pronounced ELL-ee vee-ZEL) Obj: Learn background information to understand the relevance of the novel, Night Background Information Elie Wiesel was born in Sighet, Transylvania, (now part of Romania) in 1928 At 15, Elie and his family were deported...
  • Anatomy & Physiology SIXTH EDITION Chapter 23, part

    Anatomy & Physiology SIXTH EDITION Chapter 23, part

    Chapter 23, part 4 The Respiratory System SECTION 23-9 Gas Pickup and Delivery Blood in peripheral capillaries delivers O2 and absorbs CO2 Reactions are completely reversible Figure 23.20 An Overview of Respiratory Processes and Partial Pressures in Respiration Oxygen transport...
  • PowerPoint-Präsentation

    PowerPoint-Präsentation

    eSciDoc Project eSciDoc is a joint project between the Max Planck Society (MPS) and Fachinformationszentrum (FIZ) Karlsruhe, funded by the Bundesministerium für Bildung und Forschung (BMBF). The aim of the project is the development of a re-usable service infrastructure and...
  • Earth Science: Unit 1

    Earth Science: Unit 1

    (The weather channel loves isolines!) Rules for Drawing Isobars: 1. ALL points on an isobar have the EXACT same pressure 2. Isobars are drawn at intervals. Each isobar will have a side where values are higher and a side where...