Panel |
---|
STILL BEING EDITED, NOT FINAL |
Meeting Minutes from 2012 Joint Techs in Stanford
July 16, 2012
Welcome from Ken Miller, Co-Chair of Performance Working Group
...
Wireless Broadband Measurement in California
YoungJoon Byun, Cal State, Monterey Bay
Overview of the Wireless Broadband Measurement Projectsee slides
- sponsor is CPUC (California public utilities commission)
- part of ARRA grant, administered by NTIA
- state-wide testing 2x/yr through 2014
- tool developed to measure wireless performance
- goal is to objectively evaluate major providers of mobile wireless across state of California
- currently analyzing results
- updating software for second field test in fall.
- all data available
- see http://calbroadbanddrivetest.blogspot.com/
Comments / Questions
Q: Any Are there any issues with server placement?
A: Used We used EC2, with placement in east and west coast
- final results could be averaged
- when experience server congestion, in virtual environment, spin up another one.
- looking for more in second field trial.
Q: Are you doing anything to control who can access testers?
A: No protection today
Q: Are you looking at any server data?
A: No, just client data
- curious to see if you need to do east/west thing
- Could speed up by factor of 2 if only do one.
- Any suggestions, comments, please contact
ybyun@csumb.edu
=========
ESnet - Simple Lookup Service (for perfSONAR and beyonebeyond)
Sowmya Balasubramanian, ESnet
gather requirements, look at use cases, and revamp design.
designed several years ago
but increased scale has stressed and looks like the trajectory is bad
add security.
list of requirements;
based on use cases and current load
Wiki Markup |
---|
10,000 to 100k records \[next ten years easily\]
query time < 1sec. \[else user gives up\] \[200ms?\]
registration time <1hr \[4-6 hrs to propogate today\]
validate services have not been forged |
q: 1sec, recall studies 250ms
as long as first resutls 250ms...
Simple Lookup Service Goals:
- meet needs of growing perfSONAR community
- Simple API
- Extend to non-perfSONAR services
- Security
Design:
- REST/JSON API
- Backend: MongoDB
- Flexible Architecture
Q: Assume one query?
A: Noq: assume one query?
no, but want to make sure simple query < 1sec (heard "on average")
--
To simplify API, going with REST and JSON
record management (regisr/edit)
query api (get stuff)
http get (pull)
pub/sub with http streaming (push)
unmigrated-wiki-markup
[http://odev-vm-7.es.net/lookup-service-examples] \[dev vm right place\]
design - data represeantion (so... change that design?)
well defined set of key/value pairs, but users can add too
mongo d
--
testing
- new
...
- Lookup Service and older one are on same host
...
- new Lookup Service ls is 95% faster than old one
- 1min-> under
...
- 1sec
...
- ESnet is using
...
- the new Lookup Service
- watch for alpha http://ps4.es.net:8085/lookup/services
timeframe...
few weeks
GLS.
what need Q: What is needed to do to move current isntallationinstallation? store same stuff
A: Stores the same data, different formatreally how
- How it works today:
- index servers
...
- pulls from lookup servers, create csv
...
- and use csv for initial location finding
...
...
- can modify script
...
- to talk to both
...
- (or convert index servers to
...
- new)
...
q: how do poeple do it today
old is soapy, this is json
ps tkit, registration,
upgrade switch
since consumption dont' calt directly, can move.
...
- old approach is SOAP, new approach is JSON
- GENI doing it the same way
...
- new pushes to new
...
- ; old ones pull old one
...
- Have compatible API for GENI uses
...
=======
SFLOW Data Network Visibility and Control
Neil McKee, InMon Corporation
sFlow: data network viz and control
now what sflow is?
sflow monitoring servers and apps.
where it's evolving, and go to questions.
probably have in network, think about turning it on
space for cisco
...
- sFlow: widely supported industry standard
- based on virtual network and switches
servers, hypervisors, virtual switches
2 mechanisms w/sflow that help
- de-synchronized, parallel push
auto push a full set of SNMP ifTable stuff
...
- monitors all protocols
- captures packet path
- senders all open source & free
- replaces counter polling
- allows you to do lots of things
...
- IP address,
...
- URLs,
...
- app attributes...
- things impossible to get all together
...
- , but
...
- needed for situational analysis
sFlow samples packet headers
collector decides what to analyzie
hence can get new stuff really quickly
no firmware on switches, just software collector
Wiki Markup |
---|
\-\-
captures packet path
where in and out of device
thread to find phys topo, and locate hosts to swtich ports w/in one min
\[???\] |
--
arch
agents as simple as possibe, move stuff to collector
senders all open source & free
host sflow, sends mac addrs, so can join with packets
apps: get socets, underlying hypervisor load, and packet paths
enough stuff to join and ..
host stuff:
host-sflow.sourceforge.net
app monitring
that's the new stuff.
nfs/cifs. filepath, bytes, how long, soct)
web requrest. apache, nginx...
memcached lookups... memcache clusters...
database queries.
some playing, but add if you're motivated
have json-api. fashionable, and easy to add
so app can add information.
fire and forget.
XenMotion bandwidth, how does it look
see response time in perforamance of memcache cluster
Brian T's netprobe(?)
monitoring web farm
and see tranaction detail
and see correlations
carve by app response time, is way to correlate app performance & delivery, with underlying infrastructure conspiring to deliver that.
dip when app stops.
way to pull things apart, w/o overloading anything.
Wiki Markup |
---|
why mon everything, 2 good 1 real reaon
1. troubleshooting - always have context
2. putting network and server teams on same page
so see\! \[cloud services\!\!\]
3. full observability required for automated control
control theory 101.
to automate closed loop, have to report all
guy who designed sflow is control engr |
...
now monitors more than just packets; there is also server instrumentation and it can be extended to applications
Why monitor everything with sFlow?
1. troubleshooting - always have context
2. putting network and server teams on same page
(cloud services)
3. full observability required for automated control
control theory 101.
to automate closed loop, have to report all
- sFlow and OpenFlow are complementary.
- OpenFlow can control
- if you have viz at same time, opportunity to close loop
...
- , research topic, but looks promising
danger w/openflow featuers to use for accountinga nd Q: Is there any danger using OpenFlow features for accounting and control?
much better A: Better to use wildcards when possible to openflow instead of OpenFlow controls.3
- open standards that work well
- netconf xmpl standards to set up /
...
- configure
- forwarding
...
- OpenFlow controls make sense
...
=====
The Challenge
Ken reminded the group of the challenge regarding needs for next-generation tools:
=====
Pennsylvania State University WAN Metrics Project
====
Next meeting of Performance Working Group
Internet2 Fall Member Meeting
Thursday, Oct 4, 7:30am - 8:30am
http://events.internet2.edu/2012/fall-mm/agenda.cfm?go=session&id=10002569&event=1149
cisco has a similar story, with a proprietary system
blog.sflow.com -> peter files musing
sflow.org to see if equpment supports it.
bgp stuff at oboarder, vs netflow?
sflow allows full bgp + as paths to be sent
very high-value measuremnt, to look at as paths and peering arrangment
allow you to break down by ip addr, subnets, protocols, min myb min
pull for accounting and routing perf
if routers don't support htat, can peer with router and pull aspaths in
and splice in to sflow/netflow feed, and do similar analysis
wan pov, realtime access allows for attack analysis
so a reason to find into wan routers as well as l2 switches.
PS PXE booting (brief)
to The Challenge - Ken
Mentions -
- I2 description of the proposed speed test tool
- Penn State PXE booting pS-Toolkit
Community Updates / Open Forum
any other updates
any other questions
how many people lookng at sflow
how planning/getting ready for big data challenges on networks
jim/ussc
use statseeker for all counter data
gobs of netflow
ericp: q about sflow
100G, how do that. single device how fast can go
running on brocade 100G today
turned on at SC, and it worked.
much easier for device to d sflow
sampling, decodding, aggregating, then flush out
sflow - sampling and send.
q: standard sampling rate, or all over the place
not faster than you need to
1/1000 and tweak
high level 1/40000 stillg et good data
security guys faster and faster
everyone else smooth and setady
6500s in core
10g across network
10g campuses
killing cpu when turned up more interfaces
so switched to brocade at borders, sflow
l2-7 info. before l3 only.
see more what's going on
initiative to look at core
sflow enabled dev on core, go to 100G.
can scale easily. afraid of what netflow would do if couldn't handle
10G inks
turn netflow reshalls and some things
put switch inline to do sflow to make work :)
XMRs at boarder
XLMs in core
juniper allu
sup720s out of gas
yes. prototype some new cards too, more power but still a lot of cpu
sec group, has mirrored port off of border routers
use bro cluster
get every packet off router
use sampling to trigger for security too now