<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=iso-8859-1">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Texte brut Car";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.5pt;
font-family:Consolas;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Texte de bulles Car";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.TextebrutCar
{mso-style-name:"Texte brut Car";
mso-style-priority:99;
mso-style-link:"Texte brut";
font-family:Consolas;}
span.TextedebullesCar
{mso-style-name:"Texte de bulles Car";
mso-style-priority:99;
mso-style-link:"Texte de bulles";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;}
@page Section1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="2050" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=FR link=blue vlink=purple>
<div class=Section1>
<p class=MsoPlainText>Hello,<o:p></o:p></p>
<p class=MsoPlainText>We use Varnish 2.0.6 in a production site that do about
100Mb/s and 1K Hits/s per cache.<o:p></o:p></p>
<p class=MsoPlainText><o:p> </o:p></p>
<p class=MsoPlainText>We found a strange phenomon when we added some 24H TTL to
images.<o:p></o:p></p>
<p class=MsoPlainText>The file storage seems to have some garbage collection
that deeply impact performances when freeing some large amount of cache.<o:p></o:p></p>
<p class=MsoPlainText>We initialy used 8Gb file storage and encountered some GC
at about 80% usage that freed almost all file storage (monitored with cacti
using sm_balloc,sm_bfree values).<o:p></o:p></p>
<p class=MsoPlainText>We tried on one of our cache to test with 32GB and 64GB
files but same happened even worse because on the 64GB file it did the GC at
30GB and freed until sm_balloc reached 2GB.<o:p></o:p></p>
<p class=MsoPlainText>We do not understand what is that and and to control it
so if someone as ideas around that problem ?<o:p></o:p></p>
<p class=MsoPlainText><o:p> </o:p></p>
<p class=MsoPlainText>These are some infos about the server :<o:p></o:p></p>
<p class=MsoPlainText>Hardware/OS/updates is same on cache02 and cache05<o:p></o:p></p>
<p class=MsoPlainText><o:p> </o:p></p>
<p class=MsoPlainText>root@cache02:~# ps auxwww|grep varnishd<o:p></o:p></p>
<p class=MsoPlainText>root 22731 0.0 0.0 110836 1164 ? Ss
Apr09 0:00 /usr/sbin/varnishd -P /var/run/varnishd.pid -a :80 -f
/etc/varnish/default.vcl -T :6082 -t 60 -w 100,1000,120 -s
file,/var/lib/varnish/cache02/varnish_storage.bin,8G<o:p></o:p></p>
<p class=MsoPlainText>nobody 22732 11.5 86.9 10972872 7109076 ? Sl Apr09
535:23 /usr/sbin/varnishd -P /var/run/varnishd.pid -a :80 -f /etc/varnish/default.vcl
-T :6082 -t 60 -w 100,1000,120 -s
file,/var/lib/varnish/cache02/varnish_storage.bin,8G<o:p></o:p></p>
<p class=MsoPlainText>root@cache05:~# uname -a<o:p></o:p></p>
<p class=MsoPlainText>Linux cache05 2.6.27-11-generic #1 SMP Thu Jan 29
19:28:32 UTC 2009 x86_64 GNU/Linux<o:p></o:p></p>
<p class=MsoPlainText>root@cache05:~# free<o:p></o:p></p>
<p class=MsoPlainText> total used free shared
buffers cached<o:p></o:p></p>
<p class=MsoPlainText>Mem: 8178736 8130800 47936 0
30188 6606748<o:p></o:p></p>
<p class=MsoPlainText>-/+ buffers/cache: 1493864 6684872<o:p></o:p></p>
<p class=MsoPlainText>Swap: 0 0 0<o:p></o:p></p>
<p class=MsoPlainText>Graphs for cache02 and cache05<o:p></o:p></p>
<p class=MsoPlainText><img width=569 height=223 id="Image_x0020_1"
src="cid:image001.png@01CADA2A.BEDC7140"><o:p></o:p></p>
<p class=MsoPlainText><img width=579 height=247 id="Image_x0020_2"
src="cid:image002.png@01CADA2B.30A09680"><o:p></o:p></p>
<p class=MsoPlainText><img width=579 height=247 id="Image_x0020_3"
src="cid:image003.png@01CADA2B.30A09680"><o:p></o:p></p>
<p class=MsoPlainText><o:p> </o:p></p>
<p class=MsoPlainText><img width=569 height=223 id="Image_x0020_4"
src="cid:image004.png@01CADA2B.8893FFD0"><o:p></o:p></p>
<p class=MsoPlainText><img width=579 height=247 id="Image_x0020_5"
src="cid:image005.png@01CADA2B.8893FFD0"><o:p></o:p></p>
<p class=MsoPlainText><img width=579 height=247 id="Image_x0020_6"
src="cid:image006.png@01CADA2B.8893FFD0"><o:p></o:p></p>
<p class=MsoPlainText><o:p> </o:p></p>
<p class=MsoPlainText>Sorry for the email size.<o:p></o:p></p>
<p class=MsoPlainText><o:p> </o:p></p>
<p class=MsoPlainText>--<o:p></o:p></p>
<p class=MsoPlainText>Sébastien FOUTREL<o:p></o:p></p>
<p class=MsoPlainText><o:p> </o:p></p>
</div>
</body>
</html>