Varnish memory usage
Jan-Aage Frydenbø-Bruvoll
jan at architechs.eu
Wed Jan 18 17:09:09 CET 2012
Hi,
On Wed, Jan 18, 2012 at 16:05, Andreas Plesner Jacobsen <apj at mutt.dk> wrote:
> We'd like to see varnishstat -1 and your vcl too.
proxy03 varnish # varnishstat -1
client_conn 11139628 42.95 Client connections accepted
client_drop 0 0.00 Connection dropped, no sess/wrk
client_req 48047460 185.27 Client requests received
cache_hit 42313341 163.16 Cache hits
cache_hitpass 59583 0.23 Cache hits for pass
cache_miss 4988042 19.23 Cache misses
backend_conn 3294448 12.70 Backend conn. success
backend_unhealthy 36426 0.14 Backend conn. not attempted
backend_busy 0 0.00 Backend conn. too many
backend_fail 211 0.00 Backend conn. failures
backend_reuse 2402445 9.26 Backend conn. reuses
backend_toolate 2748 0.01 Backend conn. was closed
backend_recycle 2405196 9.27 Backend conn. recycles
backend_retry 144 0.00 Backend conn. retry
fetch_head 478 0.00 Fetch head
fetch_length 5138161 19.81 Fetch with Length
fetch_chunked 475194 1.83 Fetch chunked
fetch_eof 0 0.00 Fetch EOF
fetch_bad 0 0.00 Fetch had bad headers
fetch_close 2985 0.01 Fetch wanted close
fetch_oldhttp 0 0.00 Fetch pre HTTP/1.1 closed
fetch_zero 0 0.00 Fetch zero len
fetch_failed 45 0.00 Fetch failed
fetch_1xx 0 0.00 Fetch no body (1xx)
fetch_204 0 0.00 Fetch no body (204)
fetch_304 329 0.00 Fetch no body (304)
n_sess_mem 2580 . N struct sess_mem
n_sess 1315 . N struct sess
n_object 761556 . N struct object
n_vampireobject 0 . N unresurrected objects
n_objectcore 761679 . N struct objectcore
n_objecthead 523573 . N struct objecthead
n_waitinglist 4299 . N struct waitinglist
n_vbc 12 . N struct vbc
n_wrk 136 . N worker threads
n_wrk_create 1520 0.01 N worker threads created
n_wrk_failed 0 0.00 N worker threads not created
n_wrk_max 0 0.00 N worker threads limited
n_wrk_lqueue 0 0.00 work request queue length
n_wrk_queued 26664 0.10 N queued work requests
n_wrk_drop 0 0.00 N dropped work requests
n_backend 19 . N backends
n_expired 902775 . N expired objects
n_lru_nuked 3222521 . N LRU nuked objects
n_lru_moved 395588 . N LRU moved objects
losthdr 37 0.00 HTTP header overflows
n_objsendfile 0 0.00 Objects sent with sendfile
n_objwrite 40679068 156.86 Objects sent with write
n_objoverflow 0 0.00 Objects overflowing workspace
s_sess 11139613 42.95 Total Sessions
s_req 48047460 185.27 Total Requests
s_pipe 204 0.00 Total pipe
s_pass 747967 2.88 Total pass
s_fetch 5617078 21.66 Total fetch
s_hdrbytes 18002004233 69414.68 Total header bytes
s_bodybytes 496206310294 1913342.76 Total body bytes
sess_closed 1772616 6.84 Session Closed
sess_pipeline 198838 0.77 Session Pipeline
sess_readahead 48712 0.19 Session Read Ahead
sess_linger 47017485 181.30 Session Linger
sess_herd 42381685 163.42 Session herd
shm_records 2342457931 9032.38 SHM records
shm_writes 138479662 533.97 SHM writes
shm_flushes 14 0.00 SHM flushes due to overflow
shm_cont 3181498 12.27 SHM MTX contention
shm_cycles 920 0.00 SHM cycles through buffer
sms_nreq 89029 0.34 SMS allocator requests
sms_nobj 0 . SMS outstanding allocations
sms_nbytes 0 . SMS outstanding bytes
sms_balloc 30624944 . SMS bytes allocated
sms_bfree 30624944 . SMS bytes freed
backend_req 5696167 21.96 Backend requests made
n_vcl 2 0.00 N vcl total
n_vcl_avail 2 0.00 N vcl available
n_vcl_discard 0 0.00 N vcl discarded
n_ban 709 . N total active bans
n_ban_add 5198 0.02 N new bans added
n_ban_retire 4489 0.02 N old bans deleted
n_ban_obj_test 80926784 312.05 N objects tested
n_ban_re_test 225982892 871.38 N regexps tested against
n_ban_dups 3000 0.01 N duplicate bans removed
hcb_nolock 0 0.00 HCB Lookups without lock
hcb_lock 0 0.00 HCB Lookups with lock
hcb_insert 0 0.00 HCB Inserts
esi_errors 0 0.00 ESI parse errors (unlock)
esi_warnings 0 0.00 ESI parse warnings (unlock)
accept_fail 0 0.00 Accept failures
client_drop_late 0 0.00 Connection dropped late
uptime 259340 1.00 Client uptime
dir_dns_lookups 0 0.00 DNS director lookups
dir_dns_failed 0 0.00 DNS director failed lookups
dir_dns_hit 0 0.00 DNS director cached lookups hit
dir_dns_cache_full 0 0.00 DNS director full dnscache
vmods 0 . Loaded VMODs
n_gzip 0 0.00 Gzip operations
n_gunzip 3849737 14.84 Gunzip operations
LCK.sms.creat 1 0.00 Created locks
LCK.sms.destroy 0 0.00 Destroyed locks
LCK.sms.locks 267087 1.03 Lock Operations
LCK.sms.colls 0 0.00 Collisions
LCK.smp.creat 0 0.00 Created locks
LCK.smp.destroy 0 0.00 Destroyed locks
LCK.smp.locks 0 0.00 Lock Operations
LCK.smp.colls 0 0.00 Collisions
LCK.sma.creat 2 0.00 Created locks
LCK.sma.destroy 0 0.00 Destroyed locks
LCK.sma.locks 27800385 107.20 Lock Operations
LCK.sma.colls 0 0.00 Collisions
LCK.smf.creat 0 0.00 Created locks
LCK.smf.destroy 0 0.00 Destroyed locks
LCK.smf.locks 0 0.00 Lock Operations
LCK.smf.colls 0 0.00 Collisions
LCK.hsl.creat 0 0.00 Created locks
LCK.hsl.destroy 0 0.00 Destroyed locks
LCK.hsl.locks 0 0.00 Lock Operations
LCK.hsl.colls 0 0.00 Collisions
LCK.hcb.creat 0 0.00 Created locks
LCK.hcb.destroy 0 0.00 Destroyed locks
LCK.hcb.locks 0 0.00 Lock Operations
LCK.hcb.colls 0 0.00 Collisions
LCK.hcl.creat 169313 0.65 Created locks
LCK.hcl.destroy 0 0.00 Destroyed locks
LCK.hcl.locks 93960449 362.31 Lock Operations
LCK.hcl.colls 0 0.00 Collisions
LCK.vcl.creat 1 0.00 Created locks
LCK.vcl.destroy 0 0.00 Destroyed locks
LCK.vcl.locks 8668 0.03 Lock Operations
LCK.vcl.colls 0 0.00 Collisions
LCK.stat.creat 1 0.00 Created locks
LCK.stat.destroy 0 0.00 Destroyed locks
LCK.stat.locks 2580 0.01 Lock Operations
LCK.stat.colls 0 0.00 Collisions
LCK.sessmem.creat 1 0.00 Created locks
LCK.sessmem.destroy 0 0.00 Destroyed locks
LCK.sessmem.locks 11156227 43.02 Lock Operations
LCK.sessmem.colls 0 0.00 Collisions
LCK.wstat.creat 1 0.00 Created locks
LCK.wstat.destroy 0 0.00 Destroyed locks
LCK.wstat.locks 2617990 10.09 Lock Operations
LCK.wstat.colls 0 0.00 Collisions
LCK.herder.creat 1 0.00 Created locks
LCK.herder.destroy 0 0.00 Destroyed locks
LCK.herder.locks 23393 0.09 Lock Operations
LCK.herder.colls 0 0.00 Collisions
LCK.wq.creat 4 0.00 Created locks
LCK.wq.destroy 0 0.00 Destroyed locks
LCK.wq.locks 89338248 344.48 Lock Operations
LCK.wq.colls 0 0.00 Collisions
LCK.objhdr.creat 3861706 14.89 Created locks
LCK.objhdr.destroy 3338136 12.87 Destroyed locks
LCK.objhdr.locks 108880937 419.84 Lock Operations
LCK.objhdr.colls 0 0.00 Collisions
LCK.exp.creat 1 0.00 Created locks
LCK.exp.destroy 0 0.00 Destroyed locks
LCK.exp.locks 9303270 35.87 Lock Operations
LCK.exp.colls 0 0.00 Collisions
LCK.lru.creat 2 0.00 Created locks
LCK.lru.destroy 0 0.00 Destroyed locks
LCK.lru.locks 8143794 31.40 Lock Operations
LCK.lru.colls 0 0.00 Collisions
LCK.cli.creat 1 0.00 Created locks
LCK.cli.destroy 0 0.00 Destroyed locks
LCK.cli.locks 31371 0.12 Lock Operations
LCK.cli.colls 0 0.00 Collisions
LCK.ban.creat 1 0.00 Created locks
LCK.ban.destroy 0 0.00 Destroyed locks
LCK.ban.locks 90171669 347.70 Lock Operations
LCK.ban.colls 0 0.00 Collisions
LCK.vbp.creat 1 0.00 Created locks
LCK.vbp.destroy 0 0.00 Destroyed locks
LCK.vbp.locks 2838069 10.94 Lock Operations
LCK.vbp.colls 0 0.00 Collisions
LCK.vbe.creat 1 0.00 Created locks
LCK.vbe.destroy 0 0.00 Destroyed locks
LCK.vbe.locks 6589306 25.41 Lock Operations
LCK.vbe.colls 0 0.00 Collisions
LCK.backend.creat 19 0.00 Created locks
LCK.backend.destroy 0 0.00 Destroyed locks
LCK.backend.locks 22723286 87.62 Lock Operations
LCK.backend.colls 0 0.00 Collisions
SMA.s0.c_req 11969376 46.15 Allocator requests
SMA.s0.c_fail 412116470473 1589097.21 Allocator failures
SMA.s0.c_bytes 277501708539 1070030.49 Bytes allocated
SMA.s0.c_freed 270522525345 1043119.17 Bytes freed
SMA.s0.g_alloc 1096776 . Allocations outstanding
SMA.s0.g_bytes 6979183194 . Bytes outstanding
SMA.s0.g_space 138662 . Bytes available
SMA.Transient.c_req 2763044 10.65 Allocator requests
SMA.Transient.c_fail 0 0.00 Allocator failures
SMA.Transient.c_bytes 179601302623 692532.21 Bytes allocated
SMA.Transient.c_freed 175191674974 675528.94 Bytes freed
SMA.Transient.g_alloc 429519 . Allocations outstanding
SMA.Transient.g_bytes 4409627649 . Bytes outstanding
SMA.Transient.g_space 0 . Bytes available
VBE.fake(127.0.0.1,,80).vcls 2 . VCL references
VBE.fake(127.0.0.1,,80).happy 0 . Happy health probes
VBE.app01(10.140.106.10,,80).vcls 2 . VCL references
VBE.app01(10.140.106.10,,80).happy18446744073709551615 .
Happy health probes
VBE.app02(10.140.106.11,,80).vcls 2 . VCL references
VBE.app02(10.140.106.11,,80).happy18446744073709551615 .
Happy health probes
VBE.app03(10.140.106.12,,80).vcls 2 . VCL references
VBE.app03(10.140.106.12,,80).happy18446744073709551615 .
Happy health probes
VBE.app04(10.140.106.13,,80).vcls 2 . VCL references
VBE.app04(10.140.106.13,,80).happy18446744073709551615 .
Happy health probes
VBE.app05(10.140.106.14,,80).vcls 2 . VCL references
VBE.app05(10.140.106.14,,80).happy18446744073709551615 .
Happy health probes
VBE.app06(10.140.106.15,,80).vcls 2 . VCL references
VBE.app06(10.140.106.15,,80).happy18446744073709551615 .
Happy health probes
VBE.app07(10.140.106.16,,80).vcls 2 . VCL references
VBE.app07(10.140.106.16,,80).happy18446744073709551615 .
Happy health probes
VBE.app08(10.140.106.17,,80).vcls 2 . VCL references
VBE.app08(10.140.106.17,,80).happy18446744073709551615 .
Happy health probes
VBE.app09(10.140.106.39,,80).vcls 2 . VCL references
VBE.app09(10.140.106.39,,80).happy18446744073709551615 .
Happy health probes
VBE.app10(10.140.106.40,,80).vcls 2 . VCL references
VBE.app10(10.140.106.40,,80).happy18446744073709551615 .
Happy health probes
VBE.app11(10.140.106.41,,80).vcls 2 . VCL references
VBE.app11(10.140.106.41,,80).happy18446744073709551615 .
Happy health probes
VBE.app12(10.140.106.42,,80).vcls 2 . VCL references
VBE.app12(10.140.106.42,,80).happy18446744073709551615 .
Happy health probes
VBE.app13(10.140.106.43,,80).vcls 2 . VCL references
VBE.app13(10.140.106.43,,80).happy18446744073709551615 .
Happy health probes
VBE.app14(10.140.106.46,,80).vcls 2 . VCL references
VBE.app14(10.140.106.46,,80).happy18446744073709551615 .
Happy health probes
VBE.static01(10.140.106.18,,8000).vcls 2 . VCL references
VBE.static01(10.140.106.18,,8000).happy18446744073709551615 .
Happy health probes
VBE.static02(10.140.106.19,,8000).vcls 2 . VCL references
VBE.static02(10.140.106.19,,8000).happy18446744073709551615 .
Happy health probes
VBE.static03(10.140.106.20,,8000).vcls 2 . VCL references
VBE.static03(10.140.106.20,,8000).happy18446744073709551615 .
Happy health probes
VBE.static04(10.140.106.21,,8000).vcls 2 . VCL references
VBE.static04(10.140.106.21,,8000).happy18446744073709551615 .
Happy health probes
I'd rather not post the whole VCL - is it possible to assess which
parts would be relevant here?
> My first suspicion is that objects end up in the transient storage.
How would I know?
Thanks
Jan
More information about the varnish-misc
mailing list