Varnich Memory in 90% holding continously

sujith pv sujithnss at gmail.com
Thu Jul 14 08:29:40 CEST 2016


Hi Andreas Plesner

Please find the attached. Here in above mail 30% memory usage at that time
prior to test.




On Wed, Jul 13, 2016 at 6:56 PM, Andreas Plesner <apj at mutt.dk> wrote:

> On Wed, Jul 13, 2016 at 05:15:55PM +0530, sujith pv wrote:
> >
> > I have just started using Varnish in product environment. We did a load
> > test (matching the Live load) in our application. Please find the below
> > observations
> >
> >    - Varnish with memalloc 8Gb
> >    - Varnish TTL is 2 hours
> >    - Varnish was idle just prior to test. But still memory usage was 30 %
>
> 30% of what? Measured how?
>
> > After a week again we just checked the Varnish memory (until this Varnish
> > was idle) , still it was showing up as 90% as it was during the test
> > So I was totally confused in alaysing this issue. Could you guys share
> some
> > thoughts around this please...
>
> Show us your vcl and the output of "varnishstat -1"
>
> --
> Andreas
>
> _______________________________________________
> varnish-misc mailing list
> varnish-misc at varnish-cache.org
> https://www.varnish-cache.org/lists/mailman/listinfo/varnish-misc
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/varnish-misc/attachments/20160714/357178f8/attachment-0001.html>
-------------- next part --------------
#
# This is an example VCL file for Varnish.
#
# It does not do anything by default, delegating control to the
# builtin VCL. The builtin VCL is called when there is no explicit
# return statement.
#
# See the VCL chapters in the Users Guide at https://www.varnish-cache.org/docs/
# and http://varnish-cache.org/trac/wiki/VCLExamples for more examples.

# Marker to tell the VCL compiler that this VCL has been adapted to the
# new 4.0 format.
vcl 4.0;

# Default backend definition. Set this to point to your content server.
backend default {
    #Endeca-VIP
    .host = "172.17.204.254";
    #MFEN01
    #.host = "172.25.33.125";
    #.host = "localhost";
    .port = "15001";
    #.port = "";
}

sub vcl_recv {
    # Happens before we check if we have this in cache already.
    #
    # Typically you clean up the request here, removing cookies you don't need,
    # rewriting the request, etc.
}

sub vcl_backend_response {
    # Happens after we have read the response headers from the backend.
    #
    # Here you clean the response headers, removing silly Set-Cookie headers
    # and other mistakes your backend does.
}

sub vcl_deliver {
    # Happens when we have all the pieces we need, and are about to send the
    # response to the client.
    #
    # You can do accounting or modifying the final object here.
}
-------------- next part --------------
MEMPOOL.req0.randry                         98         0.00 Pool ran dry
MEMPOOL.sess0.live                           0          .   In use
MEMPOOL.sess0.pool                          10          .   In Pool
MEMPOOL.sess0.sz_wanted                    384          .   Size requested
MEMPOOL.sess0.sz_needed                    416          .   Size allocated
MEMPOOL.sess0.allocs                    516396         0.07 Allocations
MEMPOOL.sess0.frees                     516396         0.07 Frees
MEMPOOL.sess0.recycle                   516283         0.07 Recycled from pool
MEMPOOL.sess0.timeout                    23605         0.00 Timed out from pool
MEMPOOL.sess0.toosmall                       0         0.00 Too small to recycle
MEMPOOL.sess0.surplus                        5         0.00 Too many for pool
MEMPOOL.sess0.randry                       113         0.00 Pool ran dry
MEMPOOL.req1.live                            0          .   In use
MEMPOOL.req1.pool                           10          .   In Pool
MEMPOOL.req1.sz_wanted                   65536          .   Size requested
MEMPOOL.req1.sz_needed                   65568          .   Size allocated
MEMPOOL.req1.allocs                     735530         0.09 Allocations
MEMPOOL.req1.frees                      735530         0.09 Frees
MEMPOOL.req1.recycle                    735436         0.09 Recycled from pool
MEMPOOL.req1.timeout                     22093         0.00 Timed out from pool
MEMPOOL.req1.toosmall                        0         0.00 Too small to recycle
MEMPOOL.req1.surplus                        26         0.00 Too many for pool
MEMPOOL.req1.randry                         94         0.00 Pool ran dry
MEMPOOL.sess1.live                           0          .   In use
MEMPOOL.sess1.pool                          10          .   In Pool
MEMPOOL.sess1.sz_wanted                    384          .   Size requested
MEMPOOL.sess1.sz_needed                    416          .   Size allocated
MEMPOOL.sess1.allocs                    516408         0.07 Allocations
MEMPOOL.sess1.frees                     516408         0.07 Frees
MEMPOOL.sess1.recycle                   516307         0.07 Recycled from pool
MEMPOOL.sess1.timeout                    23373         0.00 Timed out from pool
MEMPOOL.sess1.toosmall                       0         0.00 Too small to recycle
MEMPOOL.sess1.surplus                       13         0.00 Too many for pool
MEMPOOL.sess1.randry                       101         0.00 Pool ran dry
SMA.s0.c_req                           1280967         0.16 Allocator requests
SMA.s0.c_fail                           281299         0.04 Allocator failures
SMA.s0.c_bytes                     24345264927      3103.61 Bytes allocated
SMA.s0.c_freed                     24345264355      3103.61 Bytes freed
SMA.s0.g_alloc                               2          .   Allocations outstanding
SMA.s0.g_bytes                             572          .   Bytes outstanding
SMA.s0.g_space                      8589934020          .   Bytes available
SMA.Transient.c_req                       1326         0.00 Allocator requests
SMA.Transient.c_fail                         0         0.00 Allocator failures
SMA.Transient.c_bytes                   560017         0.07 Bytes allocated
SMA.Transient.c_freed                   560017         0.07 Bytes freed
SMA.Transient.g_alloc                        0          .   Allocations outstanding
SMA.Transient.g_bytes                        0          .   Bytes outstanding
SMA.Transient.g_space                        0          .   Bytes available
VBE.default(172.17.204.254,,15001).vcls            1          .   VCL references
VBE.default(172.17.204.254,,15001).happy            0          .   Happy health probes
VBE.default(172.17.204.254,,15001).bereq_hdrbytes    552916838        70.49 Request header bytes
VBE.default(172.17.204.254,,15001).bereq_bodybytes            0         0.00 Request body bytes
VBE.default(172.17.204.254,,15001).beresp_hdrbytes     25039794         3.19 Response header bytes
VBE.default(172.17.204.254,,15001).beresp_bodybytes  23799812406      3034.07 Response body bytes
VBE.default(172.17.204.254,,15001).pipe_hdrbytes               0         0.00 Pipe request header bytes
VBE.default(172.17.204.254,,15001).pipe_out                    0         0.00 Piped bytes to backend
VBE.default(172.17.204.254,,15001).pipe_in                     0         0.00 Piped bytes from backend
LCK.sms.creat                                                  0         0.00 Created locks
LCK.sms.destroy                                                0         0.00 Destroyed locks
LCK.sms.locks                                                  0         0.00 Lock Operations
LCK.smp.creat                                                  0         0.00 Created locks
LCK.smp.destroy                                                0         0.00 Destroyed locks
LCK.smp.locks                                                  0         0.00 Lock Operations
LCK.sma.creat                                                  2         0.00 Created locks
LCK.sma.destroy                                                0         0.00 Destroyed locks
LCK.sma.locks                                            2283285         0.29 Lock Operations
LCK.smf.creat                                                  0         0.00 Created locks
LCK.smf.destroy                                                0         0.00 Destroyed locks
LCK.smf.locks                                                  0         0.00 Lock Operations
LCK.hsl.creat                                                  0         0.00 Created locks
LCK.hsl.destroy                                                0         0.00 Destroyed locks
LCK.hsl.locks                                                  0         0.00 Lock Operations
LCK.hcb.creat                                                  1         0.00 Created locks
LCK.hcb.destroy                                                0         0.00 Destroyed locks
LCK.hcb.locks                                             788894         0.10 Lock Operations
LCK.hcl.creat                                                  0         0.00 Created locks
LCK.hcl.destroy                                                0         0.00 Destroyed locks
LCK.hcl.locks                                                  0         0.00 Lock Operations
LCK.vcl.creat                                                  1         0.00 Created locks
LCK.vcl.destroy                                                0         0.00 Destroyed locks
LCK.vcl.locks                                             752318         0.10 Lock Operations
LCK.sessmem.creat                                              0         0.00 Created locks
LCK.sessmem.destroy                                            0         0.00 Destroyed locks
LCK.sessmem.locks                                              0         0.00 Lock Operations
LCK.sess.creat                                           1032804         0.13 Created locks
LCK.sess.destroy                                         1032804         0.13 Destroyed locks
LCK.sess.locks                                                 0         0.00 Lock Operations
LCK.wstat.creat                                                1         0.00 Created locks
LCK.wstat.destroy                                              0         0.00 Destroyed locks
LCK.wstat.locks                                          2557060         0.33 Lock Operations
LCK.herder.creat                                               0         0.00 Created locks
LCK.herder.destroy                                             0         0.00 Destroyed locks
LCK.herder.locks                                               0         0.00 Lock Operations
LCK.wq.creat                                                   3         0.00 Created locks
LCK.wq.destroy                                                 0         0.00 Destroyed locks
LCK.wq.locks                                             8605252         1.10 Lock Operations
LCK.objhdr.creat                                          372890         0.05 Created locks
LCK.objhdr.destroy                                        372850         0.05 Destroyed locks
LCK.objhdr.locks                                        11971479         1.53 Lock Operations
LCK.exp.creat                                                  1         0.00 Created locks
LCK.exp.destroy                                                0         0.00 Destroyed locks
LCK.exp.locks                                            2415859         0.31 Lock Operations
LCK.lru.creat                                                  2         0.00 Created locks
LCK.lru.destroy                                                0         0.00 Destroyed locks
LCK.lru.locks                                            2319636         0.30 Lock Operations
LCK.cli.creat                                                  1         0.00 Created locks
LCK.cli.destroy                                                0         0.00 Destroyed locks
LCK.cli.locks                                            2614227         0.33 Lock Operations
LCK.ban.creat                                                  1         0.00 Created locks
LCK.ban.destroy                                                0         0.00 Destroyed locks
LCK.ban.locks                                           26502316         3.38 Lock Operations
LCK.vbp.creat                                                  1         0.00 Created locks
LCK.vbp.destroy                                                0         0.00 Destroyed locks
LCK.vbp.locks                                                  0         0.00 Lock Operations
LCK.backend.creat                                              1         0.00 Created locks
LCK.backend.destroy                                            0         0.00 Destroyed locks
LCK.backend.locks                                        1120863         0.14 Lock Operations
LCK.vcapace.creat                                              1         0.00 Created locks
LCK.vcapace.destroy                                            0         0.00 Destroyed locks
LCK.vcapace.locks                                              0         0.00 Lock Operations
LCK.nbusyobj.creat                                             0         0.00 Created locks
LCK.nbusyobj.destroy                                           0         0.00 Destroyed locks
LCK.nbusyobj.locks                                             0         0.00 Lock Operations
LCK.busyobj.creat                                         373621         0.05 Created locks
LCK.busyobj.destroy                                       373621         0.05 Destroyed locks
LCK.busyobj.locks                                        9753513         1.24 Lock Operations
LCK.mempool.creat                                              6         0.00 Created locks
LCK.mempool.destroy                                            0         0.00 Destroyed locks
LCK.mempool.locks                                       48259482         6.15 Lock Operations
LCK.vxid.creat                                                 1         0.00 Created locks
LCK.vxid.destroy                                               0         0.00 Destroyed locks
LCK.vxid.locks                                               778         0.00 Lock Operations
LCK.pipestat.creat                                             1         0.00 Created locks
LCK.pipestat.destroy                                           0         0.00 Destroyed locks
LCK.pipestat.locks                                             0         0.00 Lock Operations



More information about the varnish-misc mailing list