[freeside-users] sysvshell.export - High L.A. since Upgrage

Peter Kolbe peter at venturenet.co.za
Mon Jun 5 01:50:32 PDT 2006 

Hi

Freeside 1.5.8, Postgresql 8.0.4, Fedora Core 4.

Dual Intel(R) Xeon(TM) CPU 2.40GHz Hyperthreading CPU's

MemTotal:      2075788 kB
MemFree:         60212 kB
SwapTotal:     4096532 kB
SwapFree:      4095684 kB

Since upgrading to freeside-1.5.8 from 1.5.7, every time I run sysvshell.export, my Load Average shoots up to 40 to 50.
Top shows that it is a postgresql process and the sysvshell.export process that are at the top of the list, and it is almost impossible to do anything on the server

As soon as I kill sysvshell.export, my L.A drops down to 1 again.

I have diffed the sysvshell.export scripts for 1.5.7 and 1.5.8, and they are almost identical (except for some whitespace)

I turned on logging in Postgres, and when I run the sysvshell.export script, it executes thousands of queries like this (I have about 1200 services that are getting processed by this export), and am exporting to 1 host :

Please Help, 

freeside1.5.8 LOG:  statement: begin
freeside1.5.8 LOG:  duration: 0.334 ms
freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'part_export'
freeside1.5.8 LOG:  duration: 6.001 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_export WHERE exporttype = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_1
freeside1.5.8 LOG:  duration: 0.247 ms
freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'export_svc'
freeside1.5.8 LOG:  duration: 0.845 ms
freeside1.5.8 LOG:  statement: SELECT * FROM export_svc WHERE exportnum = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_2
freeside1.5.8 LOG:  duration: 0.233 ms
freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'cust_svc'
freeside1.5.8 LOG:  duration: 0.805 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_3
freeside1.5.8 LOG:  duration: 0.227 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_4
freeside1.5.8 LOG:  duration: 0.204 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_5
freeside1.5.8 LOG:  duration: 0.191 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_6
freeside1.5.8 LOG:  duration: 0.206 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_7
freeside1.5.8 LOG:  duration: 0.183 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_8
freeside1.5.8 LOG:  duration: 0.205 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_9
freeside1.5.8 LOG:  duration: 0.205 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_10
freeside1.5.8 LOG:  duration: 0.183 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_11
freeside1.5.8 LOG:  duration: 0.241 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_12
freeside1.5.8 LOG:  duration: 0.203 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_13
freeside1.5.8 LOG:  duration: 0.189 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_14
freeside1.5.8 LOG:  duration: 0.367 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_15
freeside1.5.8 LOG:  duration: 0.201 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_16
freeside1.5.8 LOG:  duration: 0.201 ms
freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'part_svc'
freeside1.5.8 LOG:  duration: 0.769 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_17
freeside1.5.8 LOG:  duration: 0.177 ms
freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'svc_acct'
freeside1.5.8 LOG:  duration: 0.775 ms
freeside1.5.8 LOG:  statement: SELECT * FROM svc_acct WHERE svcnum = $1
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_19
freeside1.5.8 LOG:  duration: 0.205 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_20
freeside1.5.8 LOG:  duration: 0.184 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_21
freeside1.5.8 LOG:  duration: 0.180 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_22
freeside1.5.8 LOG:  duration: 0.266 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_23
freeside1.5.8 LOG:  duration: 0.184 ms
freeside1.5.8 LOG:  statement: SELECT name from part_virtual_field WHERE dbtable = 'part_svc_column'
freeside1.5.8 LOG:  duration: 0.791 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_24
freeside1.5.8 LOG:  duration: 0.184 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_25
freeside1.5.8 LOG:  duration: 0.178 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_26
freeside1.5.8 LOG:  duration: 0.176 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_27
freeside1.5.8 LOG:  duration: 0.176 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_28
freeside1.5.8 LOG:  duration: 0.178 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_29
freeside1.5.8 LOG:  duration: 0.174 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_30
freeside1.5.8 LOG:  duration: 0.175 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_31
freeside1.5.8 LOG:  duration: 0.248 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_32
freeside1.5.8 LOG:  duration: 0.181 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_33
freeside1.5.8 LOG:  duration: 0.177 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_34
freeside1.5.8 LOG:  duration: 0.177 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_35
freeside1.5.8 LOG:  duration: 0.178 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_36
freeside1.5.8 LOG:  duration: 0.250 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_37
freeside1.5.8 LOG:  duration: 0.177 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_38
freeside1.5.8 LOG:  duration: 0.176 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_39
freeside1.5.8 LOG:  duration: 0.176 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1 AND columnname = $2
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_40
freeside1.5.8 LOG:  duration: 0.178 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_41
freeside1.5.8 LOG:  duration: 0.185 ms
freeside1.5.8 LOG:  statement: SELECT * FROM cust_svc WHERE svcnum = $1
freeside1.5.8 LOG:  statement: DEALLOCATE dbdpg_42
freeside1.5.8 LOG:  duration: 0.185 ms
freeside1.5.8 LOG:  statement: SELECT * FROM part_svc_column WHERE svcpart = $1

--------------------------------------------------------------------------
The information transmitted is intended only for the person to whom it is 
addressed and may contain confidential and/or privileged material.

Although SCDS / Venturenet scans incoming and outgoing emails and email 
attachments for viruses we cannot guarantee a communication to be free of 
all viruses nor accept any responsibility for viruses. 

Although SCDS / Venturenet monitors incoming and outgoing emails for 
inappropriate content, we cannot be held responsible for the views or 
expressions of the author. 

The views expressed may not necessarily be those of SCDS / Venturenet and 
as such, cannot be held responsible for any loss or injury resulting from 
the contents of a message. 
--------------------------------------------------------------------------


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://420.am/pipermail/freeside-users/attachments/20060605/31fa913f/attachment.htm

More information about the freeside-users mailing list