Varnish restarting sporadically... losing entire cache...

[Ben Nowacky]

Here's the error I get consistently: 
Jun 24 23:35:31 srv860 varnishd[20605]: Child (21427) died signal=11
Jun 24 23:35:31 srv860 varnishd[20605]: child (21660) Started
Jun 24 23:35:31 srv860 varnishd[20605]: Child (21660) said 
Jun 24 23:35:31 srv860 varnishd[20605]: Child (21660) said Child starts

Here's my config: 
"-f /usr/local/varnish-2.1.2/etc/default.vcl \
	     -s malloc,1G \
	     -p thread_pool_max=5000 \
	     -p thread_pools=4 \
	     -p thread_pool_min=200 \
	     -p thread_pool_add_delay=1ms \
	     -p cli_timeout=1000s \
	     -p ping_interval=1 \
	     -p cli_buffer=16384 \
	     -p session_linger=20ms \
	     -p lru_interval=360s \
	     -p listen_depth=8192 \
         -h classic,500009 \
	     -T localhost:2000 "

Am I doing anything in here atrocious that would be causing the random resets? I've tried file and malloc storage to no avail.. Neither one fixed the issue. I've tried adjusting sess_timeout, sess_workspace, etc... also nothing..  Changed the hash from classic to critbit also, with no success. Bashing head against the wall, if anyone has any advice could really use it ! ! 


On Jun 24, 2010, at 10:58 AM, Caunter, Stefan wrote:

> Check dmesg too, child is probably dying. Problem with persistent I
> found, I had to go back to file.
> 
> Stefan Caunter :: Senior Systems Administrator :: TOPS
> e: scaunter at topscms.com  ::  m: (416) 561-4871
> www.thestar.com www.topscms.com
> 
> 
> -----Original Message-----
> From: varnish-misc-bounces at varnish-cache.org
> [mailto:varnish-misc-bounces at varnish-cache.org] On Behalf Of Ben Nowacky
> Sent: June-24-10 1:51 PM
> To: Flavio Torres
> Cc: varnish-misc at varnish-cache.org
> Subject: Re: Varnish restarting sporadically... losing entire cache...
> 
> Thanks Flavio! Here's the errors that I see in the /var/log/messages...
> Is this what you were seeing? 
> 
> Jun 24 17:38:23 srv860 varnishd[15625]: Child (22165) Panic message:
> Assert error in SMP_FreeObj(), storage_persistent.c line 802:
> Condition(sg->nfixed > 0) not true. thread = (cache-timeout) ident =
> Linux,2.6.18-128.4.1.el5PAE,i686,-spersistent,-hclassic,epoll Backtrace:
> 0x806ca7c: pan_ic+cc   0x808851e: SMP_FreeObj+13e   0x8064b5f:
> HSH_Deref+21f   0x80618d1: exp_timer+321   0x806f1fd: wrk_bgthread+cd
> 0x44249b: /lib/libpthread.so.0 [0x44249b]   0x39942e:
> /lib/libc.so.6(clone+0x5e) [0x39942e]  
> Jun 24 17:38:23 srv860 varnishd[15625]: child (22984) Started
> Jun 24 17:38:23 srv860 varnishd[15625]: Child (22984) said 
> Jun 24 17:38:23 srv860 varnishd[15625]: Child (22984) said Child starts
> Jun 24 17:38:23 srv860 varnishd[15625]: Child (22984) said Dropped 0
> segments to make free_reserve
> Jun 24 17:38:23 srv860 varnishd[15625]: Child (22984) said Silo
> completely loaded
> On Jun 24, 2010, at 10:51 AM, Flavio Torres wrote:
>