[freeside-users] sysvshell.export - High L.A. since Upgrage

Ivan Kohler ivan at 420.am
Mon Jun 5 07:11:33 PDT 2006 

I haven't used sysvshell.export in ages, personally.  You probably want 
to track down what code changes are causing the extra queries for you.

-- 
_ivan


On Mon, Jun 05, 2006 at 10:50:32AM +0200, Peter Kolbe wrote:
> Hi
> 
> Freeside 1.5.8, Postgresql 8.0.4, Fedora Core 4.
> 
> Dual Intel(R) Xeon(TM) CPU 2.40GHz Hyperthreading CPU's
> 
> MemTotal:      2075788 kB
> MemFree:         60212 kB
> SwapTotal:     4096532 kB
> SwapFree:      4095684 kB
> 
> Since upgrading to freeside-1.5.8 from 1.5.7, every time I run sysvshell.export, my Load Average shoots up to 40 to 50.
> Top shows that it is a postgresql process and the sysvshell.export process that are at the top of the list, and it is almost impossible to do anything on the server
> 
> As soon as I kill sysvshell.export, my L.A drops down to 1 again.
> 
> I have diffed the sysvshell.export scripts for 1.5.7 and 1.5.8, and they are almost identical (except for some whitespace)
> 
> I turned on logging in Postgres, and when I run the sysvshell.export script, it executes thousands of queries like this (I have about 1200 services that are getting processed by this export), and am exporting to 1 host :
> 
> Please Help, 
> 
> freeside1.5.8 LOG:  statement: begin
> freeside1.5.8 LOG:  duration: 0.334 ms
> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'part_export'
> freeside1.5.8 LOG:  duration: 6.001 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_export WHERE exporttype = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_1
> freeside1.5.8 LOG:  duration: 0.247 ms
> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'export_svc'
> freeside1.5.8 LOG:  duration: 0.845 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM export_svc WHERE exportnum = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_2
> freeside1.5.8 LOG:  duration: 0.233 ms
> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'cust_svc'
> freeside1.5.8 LOG:  duration: 0.805 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_3
> freeside1.5.8 LOG:  duration: 0.227 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_4
> freeside1.5.8 LOG:  duration: 0.204 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_5
> freeside1.5.8 LOG:  duration: 0.191 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_6
> freeside1.5.8 LOG:  duration: 0.206 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_7
> freeside1.5.8 LOG:  duration: 0.183 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_8
> freeside1.5.8 LOG:  duration: 0.205 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_9
> freeside1.5.8 LOG:  duration: 0.205 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_10
> freeside1.5.8 LOG:  duration: 0.183 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_11
> freeside1.5.8 LOG:  duration: 0.241 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_12
> freeside1.5.8 LOG:  duration: 0.203 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_13
> freeside1.5.8 LOG:  duration: 0.189 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_14
> freeside1.5.8 LOG:  duration: 0.367 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_15
> freeside1.5.8 LOG:  duration: 0.201 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_16
> freeside1.5.8 LOG:  duration: 0.201 ms
> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'part_svc'
> freeside1.5.8 LOG:  duration: 0.769 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_17
> freeside1.5.8 LOG:  duration: 0.177 ms
> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'svc_acct'
> freeside1.5.8 LOG:  duration: 0.775 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM svc_acct WHERE svcnum = $1
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_19
> freeside1.5.8 LOG:  duration: 0.205 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_20
> freeside1.5.8 LOG:  duration: 0.184 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_21
> freeside1.5.8 LOG:  duration: 0.180 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_22
> freeside1.5.8 LOG:  duration: 0.266 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_23
> freeside1.5.8 LOG:  duration: 0.184 ms
> freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'part_svc_column'
> freeside1.5.8 LOG:  duration: 0.791 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_24
> freeside1.5.8 LOG:  duration: 0.184 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_25
> freeside1.5.8 LOG:  duration: 0.178 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_26
> freeside1.5.8 LOG:  duration: 0.176 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_27
> freeside1.5.8 LOG:  duration: 0.176 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_28
> freeside1.5.8 LOG:  duration: 0.178 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_29
> freeside1.5.8 LOG:  duration: 0.174 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_30
> freeside1.5.8 LOG:  duration: 0.175 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_31
> freeside1.5.8 LOG:  duration: 0.248 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_32
> freeside1.5.8 LOG:  duration: 0.181 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_33
> freeside1.5.8 LOG:  duration: 0.177 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_34
> freeside1.5.8 LOG:  duration: 0.177 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_35
> freeside1.5.8 LOG:  duration: 0.178 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_36
> freeside1.5.8 LOG:  duration: 0.250 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_37
> freeside1.5.8 LOG:  duration: 0.177 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_38
> freeside1.5.8 LOG:  duration: 0.176 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_39
> freeside1.5.8 LOG:  duration: 0.176 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_40
> freeside1.5.8 LOG:  duration: 0.178 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_41
> freeside1.5.8 LOG:  duration: 0.185 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
> freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_42
> freeside1.5.8 LOG:  duration: 0.185 ms
> freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1
> 
> --------------------------------------------------------------------------
> The information transmitted is intended only for the person to whom it is
> addressed and may contain confidential and/or privileged material.
> 
> Although SCDS / Venturenet scans incoming and outgoing emails and email
> attachments for viruses we cannot guarantee a communication to be free of
> all viruses nor accept any responsibility for viruses.
> 
> Although SCDS / Venturenet monitors incoming and outgoing emails for
> inappropriate content, we cannot be held responsible for the views or
> expressions of the author.
> 
> The views expressed may not necessarily be those of SCDS / Venturenet and
> as such, cannot be held responsible for any loss or injury resulting from
> the contents of a message.
> --------------------------------------------------------------------------
> 
> 

> _______________________________________________
> freeside-users mailing list
> freeside-users at sisd.com
> http://420.am/cgi-bin/mailman/listinfo/freeside-users

More information about the freeside-users mailing list