[Fryer] master FAIL. 9 of 25 tests succeeded.

fryer at oneiros.varnish-software.com fryer at oneiros.varnish-software.com
Fri Jun 1 23:56:18 CEST 2012


Tests Failed: httperf-lru-nostream-gzip httperf-lru-nostream-gzip-deflateoff httperf-lru-default httperf-lru-stream-default httperf-hot httperf-lru-nostream-nogzip cold-gzip httperf-lru-stream-gzip httperf-lru-stream-nogzip cold-nogzip lru-random siege-test httperf-lru-nostream-default httperf-rapid-expire cold-default purge-fail 


Tests OK: streaming memleak 4gpluss-stream 4gpluss basic-fryer 4gpluss-nostream streaming-grace 4gpluss-nogzip streaming-gzip 



2012-06-01 19:32:17 [1,15]: Server pantoum checked out varnish-3.0.0-beta2-1008-g2342c8b of branch master
2012-06-01 19:32:40 [2,23]: httperf-lru-nostream-gzip(httperf): Starting test
2012-06-01 19:35:34 WARNING [0,173]: httperf-lru-nostream-gzip(httperf): Panic detected. I think!
2012-06-01 19:35:34 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): 
Last panic at: Fri, 01 Jun 2012 19:34:37 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7f3f168fc388: _end+7f3f16278bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f3f24d8c9ca: _end+7f3f24709202
sp = 0x7f3f15904120 {
  fd = 16, id = 16, xid = 1025051018,
  client = 10.20.100.8 14923,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f3f15c9b158 { 
    id = "req",
    {s,f,r,e} = {0x7f3f15c9c730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f3f15c9b158[req]
      "GET",
      "/1/7/0/6/7/4.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f3f150eec60 {
    ws = 0x7f3f150eee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f3f150ee450,0x7f3f150ee450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 19:35:34 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 169 stat: 56 diff: 113). Did we crash?
2012-06-01 19:35:34 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-01 19:35:34 WARNING [0, 0]: httperf-lru-nostream-gzip(httperf): Out of bounds: client_req(204510) less than lower boundary 1999720
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Load:  21:35:34 up 1 day,  7:58,  3 users,  load average: 0.74, 0.54, 0.22

2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Test name: httperf-lru-nostream-gzip
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnish options: 
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): -t=3600
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): -s=malloc,30M
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Varnish parameters: 
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): thread_pool_max=5000
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): nuke_limit=250
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): http_gzip_support=on
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): thread_pool_min=200
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Payload size (excludes headers): 10K
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Branch: master
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Number of clients involved: 24
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Type of test: httperf
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Test iterations: 1
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Runtime: 169 seconds
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Number of total connections: 200000
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Requests per connection: 10
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-01 19:35:34 [1, 0]: httperf-lru-nostream-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-01 19:35:40 [2, 6]: httperf-lru-nostream-gzip-deflateoff(httperf): Starting test
2012-06-01 19:39:00 WARNING [0,199]: httperf-lru-nostream-gzip-deflateoff(httperf): Panic detected. I think!
2012-06-01 19:39:00 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): 
Last panic at: Fri, 01 Jun 2012 19:38:02 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7fc2af9fc3e8: _end+7fc2af378c20
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7fc2bdd019ca: _end+7fc2bd67e202
sp = 0x7fc2b3a13d20 {
  fd = 15, id = 15, xid = 1612082736,
  client = 10.20.100.8 16349,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fc2add26158 { 
    id = "req",
    {s,f,r,e} = {0x7fc2add27730,+816,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fc2add26158[req]
      "GET",
      "/1/8/4/5/7/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fc2ada8ec60 {
    ws = 0x7fc2ada8ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fc2ada8e450,0x7fc2ada8e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 19:39:00 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnishstat uptime and measured run-time is too large (measured: 196 stat: 57 diff: 139). Did we crash?
2012-06-01 19:39:00 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-01 19:39:00 WARNING [0, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Out of bounds: client_req(115270) less than lower boundary 1999720
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Load:  21:39:01 up 1 day,  8:01,  3 users,  load average: 0.89, 0.83, 0.40

2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Test name: httperf-lru-nostream-gzip-deflateoff
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnish options: 
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -t=3600
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): -s=malloc,30M
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Varnish parameters: 
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): thread_pool_max=5000
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): nuke_limit=250
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): http_gzip_support=on
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): thread_pool_min=200
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Payload size (excludes headers): 10K
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Branch: master
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Number of clients involved: 24
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Type of test: httperf
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Test iterations: 1
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Runtime: 196 seconds
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
	set beresp.do_gzip = true;
}

2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Number of total connections: 200000
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Requests per connection: 10
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-01 19:39:01 [1, 0]: httperf-lru-nostream-gzip-deflateoff(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-01 19:39:07 [2, 6]: streaming(httperf): Starting test
2012-06-01 19:41:52 [2,165]: httperf-lru-default(httperf): Starting test
2012-06-01 19:45:19 WARNING [0,206]: httperf-lru-default(httperf): Panic detected. I think!
2012-06-01 19:45:19 WARNING [0, 0]: httperf-lru-default(httperf): 
Last panic at: Fri, 01 Jun 2012 19:44:53 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7ffdd4af5388: _end+7ffdd4471bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7ffde2a669ca: _end+7ffde23e3202
sp = 0x7ffdd1508e20 {
  fd = 16, id = 16, xid = 970387626,
  client = 10.20.100.8 17691,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7ffdd2586158 { 
    id = "req",
    {s,f,r,e} = {0x7ffdd2587730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7ffdd2586158[req]
      "GET",
      "/1/9/2/3/7/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7ffdd2baec60 {
    ws = 0x7ffdd2baee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7ffdd2bae450,0x7ffdd2bae450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 19:45:19 WARNING [0, 0]: httperf-lru-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 203 stat: 24 diff: 179). Did we crash?
2012-06-01 19:45:19 WARNING [0, 0]: httperf-lru-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-01 19:45:19 WARNING [0, 0]: httperf-lru-default(httperf): Out of bounds: client_req(20000) less than lower boundary 1999720
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Load:  21:45:19 up 1 day,  8:08,  3 users,  load average: 1.02, 1.27, 0.81

2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Test name: httperf-lru-default
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Varnish options: 
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): -t=3600
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): -s=malloc,30M
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Varnish parameters: 
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): thread_pool_max=5000
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): nuke_limit=250
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): thread_pool_min=200
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Payload size (excludes headers): 10K
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Branch: master
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Number of clients involved: 24
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Type of test: httperf
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Test iterations: 1
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Runtime: 203 seconds
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Number of total connections: 200000
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Requests per connection: 10
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-01 19:45:19 [1, 0]: httperf-lru-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-01 19:45:26 [2, 6]: memleak(httperf): Starting test
2012-06-01 19:47:37 [2,131]: 4gpluss-stream(httperf): Starting test
2012-06-01 19:47:40 WARNING [0, 2]: Varnish failed to start. Fallback attempts starting
2012-06-01 19:47:40 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-01 19:47:40 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-01 19:47:41 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-01 20:06:59 [2,1158]: httperf-lru-stream-default(httperf): Starting test
2012-06-01 20:10:07 WARNING [0,187]: httperf-lru-stream-default(httperf): Panic detected. I think!
2012-06-01 20:10:07 WARNING [0, 0]: httperf-lru-stream-default(httperf): 
Last panic at: Fri, 01 Jun 2012 20:09:49 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7f8a431fc388: _end+7f8a42b78bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f8a514d19ca: _end+7f8a50e4e202
sp = 0x7f8a50e22420 {
  fd = 20, id = 20, xid = 1876965498,
  client = 10.20.100.8 17295,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f8a42822158 { 
    id = "req",
    {s,f,r,e} = {0x7f8a42823730,+568,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f8a42822158[req]
      "GET",
      "/1/8/9/5/4/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f8a4176ec60 {
    ws = 0x7f8a4176ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f8a4176e450,0x7f8a4176e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 20:10:07 WARNING [0, 0]: httperf-lru-stream-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 183 stat: 16 diff: 167). Did we crash?
2012-06-01 20:10:07 WARNING [0, 0]: httperf-lru-stream-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-01 20:10:07 WARNING [0, 0]: httperf-lru-stream-default(httperf): Out of bounds: client_req(7300) less than lower boundary 1999720
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Load:  22:10:07 up 1 day,  8:33,  3 users,  load average: 0.63, 0.71, 0.84

2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Test name: httperf-lru-stream-default
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Varnish options: 
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): -t=3600
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): -s=malloc,30M
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Varnish parameters: 
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): thread_pool_max=5000
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): nuke_limit=250
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): thread_pool_min=200
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Payload size (excludes headers): 10K
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Branch: master
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Number of clients involved: 24
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Type of test: httperf
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Test iterations: 1
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Runtime: 183 seconds
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Number of total connections: 200000
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Requests per connection: 10
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-01 20:10:07 [1, 0]: httperf-lru-stream-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-01 20:10:14 [2, 6]: httperf-hot(httperf): Starting test
2012-06-01 20:11:15 WARNING [0,61]: httperf-hot(httperf): Panic detected. I think!
2012-06-01 20:11:15 WARNING [0, 0]: httperf-hot(httperf): 
Last panic at: Fri, 01 Jun 2012 20:10:54 GMT
Assert error in VRT_handling(), cache/cache_vrt.c line 249:
  Condition(hand == VCL_RET_OK) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x7f9aaa2fca1a: _end+7f9aa9c79252
  0x43928e: VCL_deliver_method+4e
  0x419729: cnt_prepresp+269
  0x41ac6d: CNT_Session+3cd
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f9ab84a99ca: _end+7f9ab7e26202
  0x7f9ab8206cdd: _end+7f9ab7b83515
sp = 0x7f9aa8d03820 {
  fd = 21, id = 21, xid = 1892015255,
  client = 10.20.100.9 6683,
  step = STP_PREPRESP,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f9aaa50c158 { 
    id = "req",
    {s,f,r,e} = {0x7f9aaa50d730,+688,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f9aaa50c158[req]
      "GET",
      "/0/2/7.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.9",
  },
    http[resp] = {
      ws = 0x7f9aaa50c158[req]
        "HTTP/1.1",
        "OK",
        "Server: nginx/0.7.65",
        "Content-Type: text/plain",
        "Last-Modified: Fri, 01 Jun 2012 20:10:17 GMT",
        "Transfer-Encoding: chunked",
        "Date: Fri, 01 Jun 2012 20:10:54 GMT",
        "X-Varnish: 1892015255 1891931517",
        "Age: 6",
        "Via: 1.1 varnish",
        "Connection: keep-alive",
    },
  worker = 0x7f9aa906ec60 {
    ws = 0x7f9aa906ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f9aa906e450,0x7f9aa906e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
  obj = 0x7f9aa8c0e000 {
    xid = 1891931517,
    ws = 0x7f9aa8c0e018 { 
      id = "obj",
      {s,f,r,e} = {0x7f9aa8c0e1e8,+216,(nil),+248},
    },
    http[obj] = {
      ws = 0x7f9aa8c0e018[obj]
        "HTTP/1.1",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Fri, 01 Jun 2012 20:10:49 GMT",
        "Content-Type: text/plain",
        "Last-Modified: Fri, 01 Jun 2012 20:10:17 GMT",
        "Content-Encoding: gzip",
        "Content-Length: 181",
    },
    len = 181,
    store = {
      181 {
        1f 8b 08 00 00 00 00 00 00 03 25 8f 41 8e 43 31 |..........%.A.C1|
        08 43 af e2 03 54 3d 45 97 b3 9d 03 d0 04 55 96 |.C...T=E......U.|
        42 f8 4d 60 d4 e3 97 3f 7f 07 c2 7e 36 3f be d4 |B.M`...?...~6?..|
        c0 63 a7 a1 fb f0 85 cd 80 98 c6 0d cd e7 d6 16 |.c..............|
        [117 more]
      },
    },
  },
},




2012-06-01 20:11:15 WARNING [0, 0]: httperf-hot(httperf): Varnishstat uptime and measured run-time is too large (measured: 58 stat: 20 diff: 38). Did we crash?
2012-06-01 20:11:15 WARNING [0, 0]: httperf-hot(httperf): Out of bounds: client_req(90790) less than lower boundary 999640
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Load:  22:11:16 up 1 day,  8:34,  3 users,  load average: 1.98, 1.16, 0.98

2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Test name: httperf-hot
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Varnish options: 
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Varnish parameters: 
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Payload size (excludes headers): 256
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Branch: master
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Number of clients involved: 24
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Type of test: httperf
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Test iterations: 1
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Runtime: 58 seconds
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Number of total connections: 100000
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Requests per connection: 10
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Extra options to httperf: --wset=1000,0.25
2012-06-01 20:11:16 [1, 0]: httperf-hot(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 4166 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000,0.25
2012-06-01 20:11:22 [2, 6]: httperf-lru-nostream-nogzip(httperf): Starting test
2012-06-01 20:14:30 WARNING [0,187]: httperf-lru-nostream-nogzip(httperf): Panic detected. I think!
2012-06-01 20:14:30 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): 
Last panic at: Fri, 01 Jun 2012 20:13:49 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7eff349f8388: _end+7eff34374bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7eff42c139ca: _end+7eff42590202
sp = 0x7eff36e06b20 {
  fd = 16, id = 16, xid = 2022076458,
  client = 10.20.100.8 16326,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7eff32dc1158 { 
    id = "req",
    {s,f,r,e} = {0x7eff32dc2730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7eff32dc1158[req]
      "GET",
      "/1/8/0/2/0/5.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7eff32b66c60 {
    ws = 0x7eff32b66e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7eff32b66450,0x7eff32b66450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 20:14:30 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 179 stat: 40 diff: 139). Did we crash?
2012-06-01 20:14:30 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Out of bounds: n_lru_nuked(3894) less than lower boundary 80000
2012-06-01 20:14:30 WARNING [0, 0]: httperf-lru-nostream-nogzip(httperf): Out of bounds: client_req(67602) less than lower boundary 1999720
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Load:  22:14:30 up 1 day,  8:37,  3 users,  load average: 0.64, 0.97, 0.95

2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Test name: httperf-lru-nostream-nogzip
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnish options: 
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): -t=3600
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): -s=malloc,30M
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Varnish parameters: 
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): thread_pool_max=5000
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): nuke_limit=250
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): http_gzip_support=off
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): thread_pool_min=200
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Payload size (excludes headers): 10K
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Branch: master
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Number of clients involved: 24
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Type of test: httperf
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Test iterations: 1
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Runtime: 179 seconds
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Number of total connections: 200000
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Requests per connection: 10
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-01 20:14:30 [1, 0]: httperf-lru-nostream-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-01 20:14:37 [2, 6]: cold-gzip(httperf): Starting test
2012-06-01 20:17:50 WARNING [0,192]: cold-gzip(httperf): Panic detected. I think!
2012-06-01 20:17:50 WARNING [0, 0]: cold-gzip(httperf): 
Last panic at: Fri, 01 Jun 2012 20:16:41 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7f8ab63fc388: _end+7f8ab5d78bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f8ac45889ca: _end+7f8ac3f05202
sp = 0x7f8ab4868e20 {
  fd = 33, id = 33, xid = 889110100,
  client = 10.20.100.9 5313,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f8ab5886158 { 
    id = "req",
    {s,f,r,e} = {0x7f8ab5887730,+256,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f8ab5886158[req]
      "GET",
      "/0/2/2/2/7/2/2.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f8ab5925c60 {
    ws = 0x7f8ab5925e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f8ab5925450,0x7f8ab5925450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 20:17:50 WARNING [0, 0]: cold-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 188 stat: 67 diff: 121). Did we crash?
2012-06-01 20:21:04 WARNING [0,194]: cold-gzip(httperf): Panic detected. I think!
2012-06-01 20:21:04 WARNING [0, 0]: cold-gzip(httperf): 
Last panic at: Fri, 01 Jun 2012 20:19:20 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7f8ab6cf9388: _end+7f8ab6675bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f8ac45889ca: _end+7f8ac3f05202
sp = 0x7f8ab5508e20 {
  fd = 17, id = 17, xid = 484517663,
  client = 10.20.100.8 4181,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f8ab4702158 { 
    id = "req",
    {s,f,r,e} = {0x7f8ab4703730,+256,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f8ab4702158[req]
      "GET",
      "/0/1/8/2/7/6/9.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f8ab5a6dc60 {
    ws = 0x7f8ab5a6de20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f8ab5a6d450,0x7f8ab5a6d450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 20:21:04 WARNING [0, 0]: cold-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 383 stat: 104 diff: 279). Did we crash?
2012-06-01 20:21:04 WARNING [0, 0]: cold-gzip(httperf): Out of bounds: client_req(244640) less than lower boundary 1599640
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Load:  22:21:04 up 1 day,  8:43,  3 users,  load average: 0.48, 0.70, 0.83

2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Test name: cold-gzip
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Varnish options: 
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): -t=3600
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): -s=malloc,10G
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Varnish parameters: 
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): http_gzip_support=on
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Payload size (excludes headers): 256
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Branch: master
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Number of clients involved: 24
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Type of test: httperf
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Test iterations: 2
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Runtime: 383 seconds
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Number of total connections: 80000
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Requests per connection: 10
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-01 20:21:04 [1, 0]: cold-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-01 20:21:16 [2,11]: 4gpluss(httperf): Starting test
2012-06-01 20:21:19 WARNING [0, 2]: Varnish failed to start. Fallback attempts starting
2012-06-01 20:21:19 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-01 20:21:19 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-01 20:21:20 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-01 20:41:57 [2,1237]: httperf-lru-stream-gzip(httperf): Starting test
2012-06-01 20:44:50 WARNING [0,172]: httperf-lru-stream-gzip(httperf): Panic detected. I think!
2012-06-01 20:44:50 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): 
Last panic at: Fri, 01 Jun 2012 20:44:14 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7f2bdb0f5388: _end+7f2bdaa71bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f2be93779ca: _end+7f2be8cf4202
sp = 0x7f2bd9c05620 {
  fd = 13, id = 13, xid = 1210869967,
  client = 10.20.100.8 13903,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f2bd9e67158 { 
    id = "req",
    {s,f,r,e} = {0x7f2bd9e68730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f2bd9e67158[req]
      "GET",
      "/1/5/5/3/4/1.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f2bd953ec60 {
    ws = 0x7f2bd953ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f2bd953e450,0x7f2bd953e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 20:44:50 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 168 stat: 34 diff: 134). Did we crash?
2012-06-01 20:44:50 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-01 20:44:50 WARNING [0, 0]: httperf-lru-stream-gzip(httperf): Out of bounds: client_req(55550) less than lower boundary 1999720
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Load:  22:44:50 up 1 day,  9:07,  3 users,  load average: 5.17, 5.81, 3.16

2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Test name: httperf-lru-stream-gzip
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Varnish options: 
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): -t=3600
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): -s=malloc,30M
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Varnish parameters: 
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): thread_pool_max=5000
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): nuke_limit=250
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): http_gzip_support=on
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): thread_pool_min=200
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Payload size (excludes headers): 10K
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Branch: master
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Number of clients involved: 24
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Type of test: httperf
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Test iterations: 1
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Runtime: 168 seconds
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Number of total connections: 200000
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Requests per connection: 10
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-01 20:44:50 [1, 0]: httperf-lru-stream-gzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-01 20:44:57 [2, 6]: httperf-lru-stream-nogzip(httperf): Starting test
2012-06-01 20:48:16 WARNING [0,199]: httperf-lru-stream-nogzip(httperf): Panic detected. I think!
2012-06-01 20:48:16 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): 
Last panic at: Fri, 01 Jun 2012 20:46:58 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7f8f47ff9388: _end+7f8f47975bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f8f55fc69ca: _end+7f8f55943202
sp = 0x7f8f47015720 {
  fd = 22, id = 22, xid = 1599238826,
  client = 10.20.100.9 13144,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f8f45f23158 { 
    id = "req",
    {s,f,r,e} = {0x7f8f45f24730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f8f45f23158[req]
      "GET",
      "/1/4/7/5/3/1.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f8f46656c60 {
    ws = 0x7f8f46656e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f8f46656450,0x7f8f46656450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 20:48:16 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 195 stat: 77 diff: 118). Did we crash?
2012-06-01 20:48:16 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Out of bounds: n_lru_nuked(17619) less than lower boundary 80000
2012-06-01 20:48:16 WARNING [0, 0]: httperf-lru-stream-nogzip(httperf): Out of bounds: client_req(204820) less than lower boundary 1999720
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Load:  22:48:16 up 1 day,  9:11,  3 users,  load average: 0.74, 3.32, 2.69

2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Test name: httperf-lru-stream-nogzip
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnish options: 
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): -t=3600
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): -s=malloc,30M
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Varnish parameters: 
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): thread_pool_max=5000
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): nuke_limit=250
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): http_gzip_support=off
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): thread_pool_min=200
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Payload size (excludes headers): 10K
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Branch: master
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Number of clients involved: 24
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Type of test: httperf
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Test iterations: 1
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Runtime: 195 seconds
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Number of total connections: 200000
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Requests per connection: 10
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-01 20:48:16 [1, 0]: httperf-lru-stream-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-01 20:48:23 [2, 6]: basic-fryer(httperf): Starting test
2012-06-01 20:48:34 [2,11]: cold-nogzip(httperf): Starting test
2012-06-01 20:51:42 WARNING [0,187]: cold-nogzip(httperf): Panic detected. I think!
2012-06-01 20:51:42 WARNING [0, 0]: cold-nogzip(httperf): 
Last panic at: Fri, 01 Jun 2012 20:50:21 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7f29ef8fc388: _end+7f29ef278bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f29fdaa39ca: _end+7f29fd420202
sp = 0x7f29ee632720 {
  fd = 30, id = 30, xid = 1297560130,
  client = 10.20.100.9 5824,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f29f27be158 { 
    id = "req",
    {s,f,r,e} = {0x7f29f27bf730,+88,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f29f27be158[req]
      "GET",
      "/0/2/8/0/9/5/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f29eef78c60 {
    ws = 0x7f29eef78e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f29eef78450,0x7f29eef78450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 20:51:42 WARNING [0, 0]: cold-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 183 stat: 80 diff: 103). Did we crash?
2012-06-01 20:54:56 WARNING [0,193]: cold-nogzip(httperf): Panic detected. I think!
2012-06-01 20:54:56 WARNING [0, 0]: cold-nogzip(httperf): 
Last panic at: Fri, 01 Jun 2012 20:54:01 GMT
Assert error in VRT_l_beresp_do_stream(), cache/cache_vrt_var.c line 200:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43c9fd: VRT_l_beresp_do_stream+8d
  0x7f29efaf8919: _end+7f29ef475151
  0x43939e: VCL_fetch_method+4e
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f29fdaa39ca: _end+7f29fd420202
sp = 0x7f29eb60bc20 {
  fd = 30, id = 30, xid = 2059061330,
  client = 10.20.100.9 7258,
  step = STP_FETCH,
  handling = deliver,
  err_code = 200, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7f29ef9aa020 {
    ws = 0x7f29ef9aa070 { 
      id = "bo",
      {s,f,r,e} = {0x7f29ef9abaa0,+504,(nil),+58752},
    },
    do_stream
    bodystatus = 4 (length),
    },
    http[bereq] = {
      ws = 0x7f29ef9aa070[bo]
        "GET",
        "/0/3/7/7/7/8/6.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.9",
        "X-Varnish: 2059061330",
    },
    http[beresp] = {
      ws = 0x7f29ef9aa070[bo]
        "HTTP/1.1",
        "200",
        "OK",
        "Server: nginx/0.7.65",
        "Date: Fri, 01 Jun 2012 20:54:01 GMT",
        "Content-Type: text/plain",
        "Content-Length: 256",
        "Last-Modified: Fri, 01 Jun 2012 20:48:37 GMT",
        "Connection: keep-alive",
        "Accept-Ranges: bytes",
    },
  ws = 0x7f29ee9e2158 { 
    id = "req",
    {s,f,r,e} = {0x7f29ee9e3730,+800,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f29ee9e2158[req]
      "GET",
      "/0/3/7/7/7/8/6.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.9",
  },
  worker = 0x7f29eec1ac60 {
    ws = 0x7f29eec1ae20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f29eec1a450,0x7f29eec1a450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 20:54:56 WARNING [0, 0]: cold-nogzip(httperf): Varnishstat uptime and measured run-time is too large (measured: 377 stat: 53 diff: 324). Did we crash?
2012-06-01 20:54:56 WARNING [0, 0]: cold-nogzip(httperf): Out of bounds: uptime(53) less than lower boundary 100
2012-06-01 20:54:56 WARNING [0, 0]: cold-nogzip(httperf): Out of bounds: client_req(66340) less than lower boundary 1599640
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Load:  22:54:56 up 1 day,  9:17,  3 users,  load average: 0.70, 2.59, 2.76

2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Test name: cold-nogzip
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Varnish options: 
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): -t=3600
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): -s=malloc,10G
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Varnish parameters: 
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): http_gzip_support=off
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Payload size (excludes headers): 256
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Branch: master
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Number of clients involved: 24
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Type of test: httperf
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Test iterations: 2
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Runtime: 377 seconds
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Number of total connections: 80000
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Requests per connection: 10
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-01 20:54:56 [1, 0]: cold-nogzip(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-01 20:55:02 [2, 6]: 4gpluss-nostream(httperf): Starting test
2012-06-01 20:55:05 WARNING [0, 2]: Varnish failed to start. Fallback attempts starting
2012-06-01 20:55:05 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-01 20:55:06 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-01 20:55:06 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-01 21:14:37 [2,1170]: lru-random(httperf): Starting test
2012-06-01 21:14:56 WARNING [0,19]: lru-random(httperf): Panic detected. I think!
2012-06-01 21:14:56 WARNING [0, 0]: lru-random(httperf): 
Last panic at: Fri, 01 Jun 2012 21:14:46 GMT
Assert error in VRT_l_beresp_do_stream(), cache/cache_vrt_var.c line 200:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43c9fd: VRT_l_beresp_do_stream+8d
  0x7fd0a88fc919: _end+7fd0a8279151
  0x43939e: VCL_fetch_method+4e
  0x4186a9: cnt_fetch+479
  0x41accd: CNT_Session+42d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7fd0b68c39ca: _end+7fd0b6240202
sp = 0x7fd0a729b320 {
  fd = 13, id = 13, xid = 1147450252,
  client = 10.20.100.8 1800,
  step = STP_FETCH,
  handling = deliver,
  err_code = 502, err_reason = (null),
  restarts = 0, esi_level = 0
  busyobj = 0x7fd0a8b60020 {
    ws = 0x7fd0a8b60070 { 
      id = "bo",
      {s,f,r,e} = {0x7fd0a8b61aa0,+360,(nil),+58752},
    },
    do_stream
    bodystatus = 4 (length),
    },
    http[bereq] = {
      ws = 0x7fd0a8b60070[bo]
        "GET",
        "/0/6/9/2/1.html",
        "HTTP/1.1",
        "User-Agent: httperf/0.9.0",
        "Host: 10.20.100.12",
        "X-Forwarded-For: 10.20.100.8",
        "X-Varnish: 1147450252",
    },
    http[beresp] = {
      ws = 0x7fd0a8b60070[bo]
        "HTTP/1.1",
        "502",
        "Bad Gateway",
        "Server: nginx/0.7.65",
        "Date: Fri, 01 Jun 2012 21:14:46 GMT",
        "Content-Type: text/html",
        "Content-Length: 173",
        "Connection: keep-alive",
    },
  ws = 0x7fd0a7b0b158 { 
    id = "req",
    {s,f,r,e} = {0x7fd0a7b0c730,+288,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fd0a7b0b158[req]
      "GET",
      "/0/6/9/2/1.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
      "X-Forwarded-For: 10.20.100.8",
  },
  worker = 0x7fd0a7adac60 {
    ws = 0x7fd0a7adae20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fd0a7ada450,0x7fd0a7ada450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 21:14:56 WARNING [0, 0]: lru-random(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 3000
2012-06-01 21:14:56 WARNING [0, 0]: lru-random(httperf): Out of bounds: client_req(9174) less than lower boundary 29752
2012-06-01 21:14:56 WARNING [0, 0]: lru-random(httperf): Out of bounds: cache_hitpass(6865) more than upper boundary 0
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Load:  23:14:57 up 1 day,  9:37,  3 users,  load average: 0.37, 0.65, 1.23

2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Test name: lru-random
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Varnish options: 
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): -t=3600000
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): -s=malloc,1G
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Varnish parameters: 
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Payload size (excludes headers): 256
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Branch: master
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Number of clients involved: 24
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Type of test: httperf
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Test iterations: 1
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Runtime: 15 seconds
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): VCL: 

backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
//	set beresp.do_gzip = true;
}

2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Number of total connections: 10000
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Requests per connection: 3
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Extra options to httperf: --wset=100000,0.25
2012-06-01 21:14:57 [1, 0]: lru-random(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 3 --num-conns 416 --port 8080 --burst-length 3 --client 23/24 --server 10.20.100.12 --wset=100000,0.25
2012-06-01 21:15:03 [2, 6]: siege-test(siege): Starting test
2012-06-01 21:15:11 WARNING [0, 8]: siege-test(siege): Panic detected. I think!
2012-06-01 21:15:11 WARNING [0, 0]: siege-test(siege): 
Last panic at: Fri, 01 Jun 2012 21:15:08 GMT
Assert error in VRT_r_req_url(), cache/cache_vrt_var.c line 85:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43db15: VRT_r_req_url+b5
  0x7faa562fc78b: _end+7faa55c78fc3
  0x4396cb: VCL_hash_method+4b
  0x4164fe: cnt_recv+21e
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7faa647629ca: _end+7faa640df202
sp = 0x7faa5a309f20 {
  fd = 24, id = 24, xid = 2103392220,
  client = 10.20.100.7 43678,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7faa55602158 { 
    id = "req",
    {s,f,r,e} = {0x7faa55603730,+200,(nil),+59632},
  },
  http[req] = {
    ws = 0x7faa55602158[req]
      "GET",
      "/",
      "HTTP/1.1",
      "Host: 10.20.100.12:8080",
      "Accept: */*",
      "User-Agent: JoeDog/1.00 [en] (X11; I; Siege 2.66)",
      "Connection: close",
      "X-Forwarded-For: 10.20.100.7",
      "Accept-Encoding: gzip",
  },
  worker = 0x7faa5661ac60 {
    ws = 0x7faa5661ae20 { 
      id = "wrk",
      {s,f,r,e} = {0x7faa5661a450,0x7faa5661a450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 21:15:11 WARNING [0, 0]: siege-test(siege): Out of bounds: uptime(2) less than lower boundary 13
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Load:  23:15:12 up 1 day,  9:38,  3 users,  load average: 0.29, 0.62, 1.20

2012-06-01 21:15:12 [1, 0]: siege-test(siege): Test name: siege-test
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Varnish options: 
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Varnish parameters: 
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Payload size (excludes headers): 256
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Branch: master
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Number of clients involved: 0
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Type of test: siege
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Test iterations: 1
2012-06-01 21:15:12 [1, 0]: siege-test(siege): Runtime: 4 seconds
2012-06-01 21:15:12 [1, 0]: siege-test(siege): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 21:15:18 [2, 6]: httperf-lru-nostream-default(httperf): Starting test
2012-06-01 21:18:45 WARNING [0,206]: httperf-lru-nostream-default(httperf): Panic detected. I think!
2012-06-01 21:18:45 WARNING [0, 0]: httperf-lru-nostream-default(httperf): 
Last panic at: Fri, 01 Jun 2012 21:18:02 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7f1e611fa388: _end+7f1e60b76bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7f1e6f2349ca: _end+7f1e6ebb1202
sp = 0x7f1e5e8b6e20 {
  fd = 18, id = 18, xid = 1256616588,
  client = 10.20.100.8 17862,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7f1e5ef19158 { 
    id = "req",
    {s,f,r,e} = {0x7f1e5ef1a730,+248,(nil),+59632},
  },
  http[req] = {
    ws = 0x7f1e5ef19158[req]
      "GET",
      "/1/9/6/7/9/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7f1e5f20ec60 {
    ws = 0x7f1e5f20ee20 { 
      id = "wrk",
      {s,f,r,e} = {0x7f1e5f20e450,0x7f1e5f20e450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 21:18:45 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 203 stat: 42 diff: 161). Did we crash?
2012-06-01 21:18:45 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Out of bounds: n_lru_nuked(0) less than lower boundary 80000
2012-06-01 21:18:45 WARNING [0, 0]: httperf-lru-nostream-default(httperf): Out of bounds: client_req(83050) less than lower boundary 1999720
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Load:  23:18:45 up 1 day,  9:41,  3 users,  load average: 0.79, 0.84, 1.17

2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Test name: httperf-lru-nostream-default
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Varnish options: 
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): -t=3600
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): -s=malloc,30M
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Varnish parameters: 
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): thread_pool_max=5000
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): nuke_limit=250
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): thread_pool_min=200
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Payload size (excludes headers): 10K
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Branch: master
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Number of clients involved: 24
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Type of test: httperf
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Test iterations: 1
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Runtime: 203 seconds
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = false;
}

2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Number of total connections: 200000
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Requests per connection: 10
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Extra options to httperf: --wset=1000000,0.1
2012-06-01 21:18:45 [1, 0]: httperf-lru-nostream-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 8333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=1000000,0.1
2012-06-01 21:18:52 [2, 6]: httperf-rapid-expire(httperf): Starting test
2012-06-01 21:19:52 WARNING [0,59]: httperf-rapid-expire(httperf): Panic detected. I think!
2012-06-01 21:19:52 WARNING [0, 0]: httperf-rapid-expire(httperf): 
Last panic at: Fri, 01 Jun 2012 21:19:22 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7fc550ff9388: _end+7fc550975bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7fc55f21e9ca: _end+7fc55eb9b202
sp = 0x7fc552c06c20 {
  fd = 16, id = 16, xid = 684771977,
  client = 10.20.100.8 6299,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fc54fd0e158 { 
    id = "req",
    {s,f,r,e} = {0x7fc54fd0f730,+224,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fc54fd0e158[req]
      "GET",
      "/1/3.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fc54ff61c60 {
    ws = 0x7fc54ff61e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fc54ff61450,0x7fc54ff61450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 21:19:52 WARNING [0, 0]: httperf-rapid-expire(httperf): Out of bounds: client_req(140076) less than lower boundary 999640
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Load:  23:19:52 up 1 day,  9:42,  3 users,  load average: 0.74, 0.83, 1.15

2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Test name: httperf-rapid-expire
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Varnish options: 
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): -t=2
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Varnish parameters: 
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Payload size (excludes headers): 256
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Branch: master
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Number of clients involved: 24
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Type of test: httperf
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Test iterations: 1
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Runtime: 56 seconds
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Number of total connections: 100000
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Requests per connection: 10
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Extra options to httperf: --wset=100,0.30
2012-06-01 21:19:52 [1, 0]: httperf-rapid-expire(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 4166 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=100,0.30
2012-06-01 21:19:59 [2, 6]: streaming-grace(httperf): Starting test
2012-06-01 21:22:42 [2,163]: cold-default(httperf): Starting test
2012-06-01 21:26:07 WARNING [0,204]: cold-default(httperf): Panic detected. I think!
2012-06-01 21:26:07 WARNING [0, 0]: cold-default(httperf): 
Last panic at: Fri, 01 Jun 2012 21:25:18 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7fe0cbafc388: _end+7fe0cb478bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7fe0d9c4f9ca: _end+7fe0d95cc202
sp = 0x7fe0cae02320 {
  fd = 21, id = 21, xid = 958210428,
  client = 10.20.100.9 6471,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fe0c9402158 { 
    id = "req",
    {s,f,r,e} = {0x7fe0c9403730,+256,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fe0c9402158[req]
      "GET",
      "/0/2/9/1/7/2/0.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fe0cb088c60 {
    ws = 0x7fe0cb088e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fe0cb088450,0x7fe0cb088450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 21:26:07 WARNING [0, 0]: cold-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 200 stat: 47 diff: 153). Did we crash?
2012-06-01 21:29:34 WARNING [0,206]: cold-default(httperf): Panic detected. I think!
2012-06-01 21:29:34 WARNING [0, 0]: cold-default(httperf): 
Last panic at: Fri, 01 Jun 2012 21:27:32 GMT
Assert error in VRT_r_req_restarts(), cache/cache_vrt_var.c line 365:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43bbe5: VRT_r_req_restarts+65
  0x7fe0cb9f5388: _end+7fe0cb371bc0
  0x4399fb: VCL_recv_method+4b
  0x4164c5: cnt_recv+1e5
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7fe0d9c4f9ca: _end+7fe0d95cc202
sp = 0x7fe0caa06520 {
  fd = 32, id = 32, xid = 330547365,
  client = 10.20.100.7 4115,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fe0ca789158 { 
    id = "req",
    {s,f,r,e} = {0x7fe0ca78a730,+256,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fe0ca789158[req]
      "GET",
      "/0/1/8/9/0/1/8.html",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fe0cb125c60 {
    ws = 0x7fe0cb125e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fe0cb125450,0x7fe0cb125450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 21:29:34 WARNING [0, 0]: cold-default(httperf): Varnishstat uptime and measured run-time is too large (measured: 408 stat: 121 diff: 287). Did we crash?
2012-06-01 21:29:34 WARNING [0, 0]: cold-default(httperf): Out of bounds: client_req(327364) less than lower boundary 1599640
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Load:  23:29:34 up 1 day,  9:52,  3 users,  load average: 0.57, 0.82, 1.02

2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Test name: cold-default
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Varnish options: 
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): -t=3600
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): -s=malloc,10G
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Varnish parameters: 
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Payload size (excludes headers): 256
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Branch: master
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Number of clients involved: 24
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Type of test: httperf
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Test iterations: 2
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Runtime: 408 seconds
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_fetch {
	set beresp.do_stream = true;
}

2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Number of total connections: 80000
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Requests per connection: 10
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Extra options to httperf: --wset=4000000,0.50
2012-06-01 21:29:34 [1, 0]: cold-default(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 10 --num-conns 3333 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=4000000,0.50
2012-06-01 21:29:40 [2, 6]: 4gpluss-nogzip(httperf): Starting test
2012-06-01 21:29:48 WARNING [0, 7]: Varnish failed to start. Fallback attempts starting
2012-06-01 21:29:48 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: thread_pool_max=300
2012-06-01 21:29:49 [1, 0]: Removed (hopefully incompatible) parameter to try to start varnish. Key: sess_timeout=60000s
2012-06-01 21:29:49 [1, 0]: Fallback worked. Parameter that seemed to cause problems: sess_timeout
2012-06-01 21:50:18 [2,1229]: purge-fail(httperf): Starting test
2012-06-01 21:53:48 WARNING [0,209]: purge-fail(httperf): Panic detected. I think!
2012-06-01 21:53:48 WARNING [0, 0]: purge-fail(httperf): 
Last panic at: Fri, 01 Jun 2012 21:53:05 GMT
Assert error in VRT_r_req_url(), cache/cache_vrt_var.c line 85:
  Condition((sp) != NULL) not true.
thread = (cache-worker)
ident = Linux,2.6.32-38-generic,x86_64,-smalloc,-smalloc,-hcritbit,epoll
Backtrace:
  0x431d48: pan_ic+d8
  0x43db15: VRT_r_req_url+b5
  0x7fdcc2ef9707: _end+7fdcc2875f3f
  0x4396cb: VCL_hash_method+4b
  0x4164fe: cnt_recv+21e
  0x41ae1d: CNT_Session+57d
  0x4366cd: ses_pool_task+fd
  0x433552: Pool_Work_Thread+112
  0x4407f8: wrk_thread_real+c8
  0x7fdcd0f7f9ca: _end+7fdcd08fc202
sp = 0x7fdcc492c220 {
  fd = 19, id = 19, xid = 361956220,
  client = 10.20.100.7 25244,
  step = STP_RECV,
  handling = deliver,
  restarts = 0, esi_level = 0
  ws = 0x7fdcc1835158 { 
    id = "req",
    {s,f,r,e} = {0x7fdcc1836730,+96,(nil),+59632},
  },
  http[req] = {
    ws = 0x7fdcc1835158[req]
      "PURGE",
      "/foo",
      "HTTP/1.1",
      "User-Agent: httperf/0.9.0",
      "Host: 10.20.100.12",
  },
  worker = 0x7fdcc1f91c60 {
    ws = 0x7fdcc1f91e20 { 
      id = "wrk",
      {s,f,r,e} = {0x7fdcc1f91450,0x7fdcc1f91450,(nil),+2048},
    },
  },
    vcl = {
      srcname = {
        "input",
        "Default",
      },
    },
},




2012-06-01 21:53:48 WARNING [0, 0]: purge-fail(httperf): Varnishstat uptime and measured run-time is too large (measured: 205 stat: 41 diff: 164). Did we crash?
2012-06-01 21:53:48 WARNING [0, 0]: purge-fail(httperf): Out of bounds: client_req(31117) less than lower boundary 299800
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Load:  23:53:48 up 1 day, 10:16,  3 users,  load average: 0.41, 0.62, 0.97

2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Test name: purge-fail
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Varnish options: 
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Varnish parameters: 
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Payload size (excludes headers): 1K
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Branch: master
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Number of clients involved: 24
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Type of test: httperf
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Test iterations: 1
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Runtime: 205 seconds
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): VCL: 
backend foo {
	.host = "localhost";
	.port = "80";
}

sub vcl_recv {
	if (!req.url ~ "/0/0.html") {
		set req.request = "PURGE";
	}
	set req.url = "/foo";
	return (lookup);
}
sub vcl_hit {
	if (req.request == "PURGE") {
		set obj.ttl = 0s;
		error 200 "OK";
	}
}
sub vcl_miss {
	if (req.request == "PURGE") {
		error 200 "Not in cache but not confusing httperf";
	}
}


2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Number of total connections: 300000
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Note: connections are subject to rounding when divided among clients. Expect slight deviations.
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Requests per connection: 1
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Extra options to httperf: --wset=999,0.5 --timeout=5
2012-06-01 21:53:48 [1, 0]: purge-fail(httperf): Httperf command (last client): httperf --hog --timeout 60 --num-calls 1 --num-conns 12500 --port 8080 --burst-length 10 --client 23/24 --server 10.20.100.12 --wset=999,0.5 --timeout=5
2012-06-01 21:53:55 [2, 6]: streaming-gzip(httperf): Starting test
2012-06-01 21:56:18 WARNING [0,143]: Tests finished with problems detected. Failed expectations: 16 Total run time: 8656 seconds 



More information about the varnish-test mailing list