__________
Technorati Tags:
UltraSPARC T1 | UltraSPARC T2 | Java Performance | Oracle E-Business Suite | Oracle Applications
netstat -a
on Solaris to check the state of TCP connections on Solaris) in real world production systems. Here is a little background on the IDLE state for TCP socket connections:bind()
system call in order to make the server port to listen or connect()
call from client to communicate with the server.bind()
is not used in the server program; or the equivalent connect()
in the client program, the state of the TCP connection will be IDLE. Check the tcp.h
for relevant comments.% grep IDLE /usr/include/inet/tcp.h
#define TCPS_IDLE -5 /* idle (opened, but not bound) */
SO_KEEPALIVE
socket option via the setsockopt(3SOCKET)
socket call. Once enabled, a keepalive probe packet is sent to the other end of the socket provided the connection has remained in the ESTABLISHED
state and has been idle for the specified time frame. This time frame is the value specified by the TCP tunable tcp_keepalive_interval
.tcp_ip_abort_interval
, the connection is terminated, as would be the case for any other unacknowledged packet. Hence the actual maximum idle time of a connection utilizing TCP keepalive, which has no responding peer will therefore be:tcp_keepalive_interval + tcp_ip_abort_interval.
/usr/sbin/ndd -set /dev/tcp tcp_keepalive_interval <value in milliseconds>
/usr/sbin/ndd -set /dev/tcp tcp_ip_abort_interval <value in milliseconds>
send
system call. It is sending on a valid fd but the question we have is that, is there any way to find who is on the other end of that fd? We want to know to which process is that message being sent to. [...]% prstat
PID USERNAME SIZE RSS STATE PRI NICE TIME CPU PROCESS/NLWP
22385 mandalik 180M 64M sleep 49 0 0:05:15 0.1% thunderbird-bin/5
pfiles
on the pid - it prints a list of open files including open sockets (pfiles
is the Solaris supported equivalent of lsof
utility).% pfiles 22385
22385: /usr/lib/thunderbird/thunderbird-bin -UILocale C -contentLocale C
Current rlimit: 512 file descriptors
...
...
33: S_IFSOCK mode:0666 dev:280,0 ino:31544 uid:0 gid:0 size:0
O_RDWR|O_NONBLOCK
SOCK_STREAM
SO_SNDBUF(49152),SO_RCVBUF(49640)
sockname: AF_INET 192.168.1.2 port: 60364
peername: AF_INET 192.18.39.10 port: 993
...
...
pfiles pid
(see step #2).netstat -a | egrep "<sockport#>|<peerport#>
(get the port numbers from step 3); and check the state of the socket connection. If you see anything other than ESTABLISHED
, it indicates trouble.% netstat -a | egrep "60364|993"
solaris-devx-iprb0.60364 mail-sfbay.sun.com.993 48460 0 49640 0 ESTABLISHED
netstat
with option -n
.% netstat -an | egrep "60364|993"
192.168.1.2.60364 192.18.39.10.993 49559 0 49640 0 ESTABLISHED
netstat -an | egrep '<localport#>|<remoteport#>
.CLOSE_WAIT
, have a look at the following diagnosis: CPU hog with connections in CLOSE_WAIT.root
user on the remote host.cd /proc
pfiles * | egrep "^[0-9]|sockname" > /tmp/pfiles.txt
.vi /tmp/pfiles.txt
and search for the port number. If you scroll few lines up, you can see the process ID, name of the process along with its argument(s).Store Name | Description of the Item | Price | Misc Info |
Circuit City | MIO Portable Navigation GPS(MIO) | $99.99 | |
Linens & Things | Amcor A3900 GPS Navigation System (Amcor) | $99.99 | MIR |
Office Depot | Maxx Digital Portable GPS System (Maxx Digital) | $99.99 | |
Best Buy | TomTom ONE LE GPS(TomTom) | $119.99 | |
Circuit City | Magellan Roadmate 1200 Portable GPS(Magellan) | $124.99 | |
Staples | TomTom ONE 3rd Edition Portable GPS(TomTom) | $124.99 | |
WalMart | Garmin StreetPilot C330 GPS(Garmin) | $128.88 | |
Kohl's | GPS Navigation System(Unknown) | $129.99 | |
Office Depot | Tom Tom ONE 3.5" Portable GPS (TomTom) | $129.99 | |
Radio Shack | Megellan Maestro 3100 GPS(Magellan) | $129.99 | |
Radio Shack | TomTom ONE Third Edition GPS(TomTom) | $139.99 | |
CompUSA-TG | Magellan Maestro 3100 GPS Navigation System (Magellan) | $147.99 | |
Target | Magellan Maestro 3100 Auto GPS(Magellan) | $149.00 | |
CompUSA | TomTom One 3rd Edition GPS Navigation System (TomTom) | $149.99 | |
Costco.com | Magellan Triton 500 Handheld Outdoor GPS(Magellan) | $149.99 | |
Radio Shack | Navigon 2100 GPS w/ Traffic Service(Navigon) | $149.99 | |
Radio Shack | Mio C320 GPS(MIO) | $149.99 | |
JC Penney | Invion 3.5" Text To Voice Touchscreen GPS System(Invion) | $169.88 | |
Best Buy | Garmin Nuvi 200 GPS(Garmin) | $169.99 | |
Circuit City | Garmin GPS(Garmin) | $199.99 | |
Toys R Us | Magellan Maestro 4000 GPS(Magellan) | $219.99 | |
CompUSA | Garmin nuvi 200W GPS Navigation System (Garmin) | $249.99 | |
Office Max | Magellan Maestro 4000 GPS Auto Navigation System(Magellan) | $249.99 | |
Sears | Magellan GPS Maestro 4000(Magellan) | $249.99 | |
Office Depot | Tom Tom XLS 4.3" Portable GPS (TomTom) | $259.99 | |
Circuit City | Garmin GPS Navigation w/ Slim Profile(Garmin) | $299.99 | |
CompUSA | Magellan Maestro 4210 GPS Navigation System (Magellan) | $299.99 | |
Radio Shack | Magellan Maestro 4040 GPS(Magellan) | $299.99 | |
Best Buy | Garmin StreetPilot C550 GPS(Garmin) | $329.99 | |
Linens & Things | Garmin nuvi 200W Voice-Prompted GPS System (Garmin) | $349.99 | |
Best Buy | Garmin nuvi 660 GPS(Garmin) | $399.99 | |
CompUSA | HP iPAQ 310 Travel Companion GPS System (HP) | $399.99 | |
CompUSA | Garmin StreetPilot C580 GPS Navigation System (Garmin) | $399.99 | |
Office Depot | Tom Tom 100 4.3" Portable GPS (TomTom) | $449.99 |
% unzip solaris.sparc64_11gR1_client.zip
clientruntime.rsp
.% cd client/response
% cp clientruntime.rsp clientruntime.rsp.orig
UNIX_GROUP_NAME, FROM_LOCATION, ORACLE_BASE, ORACLE_HOME
and ORACLE_HOME_NAME
./export/home/oracle
with UNIX group name dba
:% diff clientruntime.rsp clientruntime.rsp.orig
35c35
< UNIX_GROUP_NAME=dba
---
> UNIX_GROUP_NAME=<Value Unspecified>
43c43
< FROM_LOCATION="/export/home/client/stage/products.xml"
---
> FROM_LOCATION="../source/client/Disk1/stage/products.xml"
62c62
< ORACLE_BASE=/export/home/oracle
---
> ORACLE_BASE=<Value Required>
70c70
< ORACLE_HOME=/export/home/oracle
---
> ORACLE_HOME=<Value Required>
78c78
< ORACLE_HOME_NAME=oracle11gr1
---
> ORACLE_HOME_NAME=<Value Required>
-silent
option, and input the response file you just edited../runInstaller -silent -responseFile /export/home/client/response/clientruntime.rsp
Starting Oracle Universal Installer...
Checking Temp space: must be greater than 180 MB. Actual 70778 MB Passed
Checking swap space: must be greater than 150 MB. Actual 71261 MB Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2007-11-13_10-29-33PM. Please wait ...
Oracle Universal Installer, Version 11.1.0.6.0 Production
Copyright (C) 1999, 2007, Oracle. All rights reserved.
You can find the log of this install session at:
/export/home/oraInventory/logs/installActions2007-11-13_10-29-33PM.log
............................................................................... 100% Done.
...
...
Installation in progress (Tue Nov 13 22:30:10 PST 2007)
............................................................... 75% Done.
. 75% Done.
Install successful
Linking in progress (Tue Nov 13 22:32:32 PST 2007)
. 75% Done.
Link successful
Setup in progress (Tue Nov 13 22:33:13 PST 2007)
.................. 100% Done.
Setup successful
End of install phases.(Tue Nov 13 22:33:23 PST 2007)
Starting to execute configuration assistants
Configuration assistant "Oracle Net Configuration Assistant" succeeded
WARNING:A new inventory has been created in this session. However, it has not yet been registered
as the central inventory of this system.
To register the new inventory please run the script '/export/home/oraInventory/orainstRoot.sh'
with root privileges.
If you do not register the inventory, you may not be able to update or patch the products you installed.
The following configuration scripts need to be executed as the "root" user.
#!/bin/sh
#Root script to run
/export/home/oraInventory/orainstRoot.sh
/export/home/oracle/root.sh
To execute the configuration scripts:
1. Open a terminal window
2. Log in as "root"
3. Run the scripts
The installation of Oracle Client was successful.
Please check '/export/home/oraInventory/logs/silentInstall2007-11-13_10-29-33PM.log' for more details.
% su
Password:
# /export/home/oraInventory/orainstRoot.sh
Changing permissions of /export/home/oraInventory to 770.
Changing groupname of /export/home/oraInventory to dba.
The execution of the script is complete
# /export/home/oracle/root.sh
/export/home/siebel/siebsrvr/lib/libsslcosd.so:0x4ad24
/lib/libc.so.1:0xc5924
/lib/libc.so.1:0xba868
/export/home/oracle/lib32/libclntsh.so.10.1:kpuhhfre+0x8d0 [ Signal 11 (SEGV)]
/export/home/oracle/lib32/libclntsh.so.10.1:kpufhndl0+0x35ac
/export/home/siebel/siebsrvr/lib/libsscdo90.so:0x3140c
/export/home/siebel/siebsrvr/lib/libsscfdm.so:0x677944
/export/home/siebel/siebsrvr/lib/libsscfdm.so:__1cQCSSLockSqlCursorGDelete6M_v_+0x264
/export/home/siebel/siebsrvr/lib/libsscfdm.so:__1cJCSSDbConnOCacheSqlCursor6MpnMCSSSqlCursor__I_+0x734
/export/home/siebel/siebsrvr/lib/libsscfdm.so:__1cJCSSDbConnRTryCacheSqlCursor6MpnMCSSSqlCursor_b_I_+0xcc
/export/home/siebel/siebsrvr/lib/libsscfdm.so:__1cJCSSSqlObjOCacheSqlCursor6MpnMCSSSqlCursor_b_I_+0x6e4
/export/home/siebel/siebsrvr/lib/libsscfdm.so:__1cJCSSSqlObjHRelease6Mb_v_+0x4d0
/export/home/siebel/siebsrvr/lib/libsscfom.so:__1cKCSSBusComp2T5B6M_v_+0x790
/export/home/siebel/siebsrvr/lib/libsscacmbc.so:__1cJCSSBCBase2T5B6M_v_+0x640
/export/home/siebel/siebsrvr/lib/libsscasabc.so:0x19275c
/export/home/siebel/siebsrvr/lib/libsscfom.so:0x318774
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:__1cWCSSSWEFrameMgrInternalPReleaseBOScreen6M_v_+0x10c
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cWCSSSWEFrameMgrInternalJBuildView6MpkHnLBUILDSCREEN_pnSCSSSWEViewBookmark_ipnJCSSBusObj_pnPCSSDrilldownDef_p1pI_I_+0x18b0
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cWCSSSWEFrameMgrInternalJBuildView6MrpnKCSSSWEView_pkHnLBUILDSCREEN_pnSCSSSWEViewBookmark_ipnJCSSBusObj_pnPCSSDrilldownDef_p4_I_+0x50
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cPCSSSWEActionMgrUActionBuildViewAsync6MpnbACSSSWEActionBuildViewAsync_pnQCSSSWEHtmlStream_pnNWWEReqModInfo_rpnJWWECbInfo__I_+0x38c
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cPCSSSWEActionMgrODoPostedAction6MpnQCSSSWEHtmlStream_pnNWWEReqModInfo_rpnJWWECbInfo__I_+0x104
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cPCSSSWEActionMgrSCheckPostedActions6MpnQCSSSWEHtmlStream_pnKCSSSWEArgs_pnNWWEReqModInfo_rpnJWWECbInfo_ri_I_+0x378
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cWCSSSWEFrameMgrInternalSInvokeAppletMethod6MpnQCSSSWEHtmlStream_pnKCSSSWEArgs_pnNWWEReqModInfo_rpnJWWECbInfo_rnOCSSStringArray__I_+0x12f8
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cSCSSSWECmdProcessorMInvokeMethod6MpnQCSSSWEHtmlStream_pnKCSSSWEArgs_pnNWWEReqModInfo_rpnJWWECbInfo__I_+0x88c
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cSCSSSWECmdProcessorP_ProcessCommand6MpnQCSSSWEHtmlStream_pnNWWEReqModInfo_rpnJWWECbInfo__I_+0x860
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cSCSSSWECmdProcessorOProcessCommand6MpnUCSSSWEGenericRequest_pnVCSSSWEGenericResponse_rpnNWWEReqModInfo_rpnJWWECbInfo__I_+0x9bc
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:
__1cSCSSSWECmdProcessorOProcessCommand6MpnRCSSSWEHttpRequest_pnSCSSSWEHttpResponse_rpnJWWECbInfo__I_+0xd8
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:__1cSCSSServiceSWEIfaceHRequest6MpnMCSSSWEReqRec_pnRCSSSWEResponseRec__I_+0x404
/export/home/siebel/siebsrvr/lib/libsscaswbc.so:__1cSCSSServiceSWEIfaceODoInvokeMethod6MpkHrknOCCFPropertySet_r3_I_+0xa80
/export/home/siebel/siebsrvr/lib/libsscfom.so:__1cKCSSServiceMInvokeMethod6MpkHrknOCCFPropertySet_r3_I_+0x244
/export/home/siebel/siebsrvr/lib/libsstcsiom.so:__1cOCSSSIOMSessionTModInvokeSrvcMethod6MpkHp13rnISSstring__i_+0x124
/export/home/siebel/siebsrvr/lib/libsstcsiom.so:
__1cOCSSSIOMSessionMRPCMiscModel6MnMSISOMRPCCode_nMSISOMArgType_LpnSCSSSISOMRPCArgList_4ripv_i_+0x5bc
/export/home/siebel/siebsrvr/lib/libsstcsiom.so:
__1cOCSSSIOMSessionJHandleRPC6MnMSISOMRPCCode_nMSISOMArgType_LpnSCSSSISOMRPCArgList_4ripv_i_+0xb98
/export/home/siebel/siebsrvr/lib/libsssasos.so:__1cJCSSClientLHandleOMRPC6MpnMCSSClientReq__I_+0x78
/export/home/siebel/siebsrvr/lib/libsssasos.so:__1cJCSSClientNHandleRequest6MpnMCSSClientReq__I_+0x2f8
/export/home/siebel/siebsrvr/lib/libsssasos.so:0x8c2c4
/export/home/siebel/siebsrvr/lib/libsssasos.so:__1cLSOMMTServerQSessionHandleMsg6MpnJsmiSisReq__i_+0x1bc
/export/home/siebel/siebsrvr/bin/siebmtshmw:__1cNsmiMainThreadUCompSessionHandleMsg6MpnJsmiSisReq__i_+0x16c
/export/home/siebel/siebsrvr/bin/siebmtshmw:__1cM_smiMessageQdDOProcessMessage6MpnM_smiMsgQdDItem_li_i_+0x93c
/export/home/siebel/siebsrvr/bin/siebmtshmw:__1cM_smiMessageQdDOProcessRequest6Fpv1r1_i_+0x244
/export/home/siebel/siebsrvr/bin/siebmtshmw:__1cN_smiWorkQdDueuePProcessWorkItem6Mpv1r1_i_+0xd4
/export/home/siebel/siebsrvr/bin/siebmtshmw:__1cN_smiWorkQdDueueKWorkerTask6Fpv_i_+0x300
/export/home/siebel/siebsrvr/bin/siebmtshmw:__1cQSmiThrdEntryFunc6Fpv_i_+0x46c
/export/home/siebel/siebsrvr/lib/libsslcosd.so:0x5be88
/export/home/siebel/siebsrvr/mw/lib/libmfc400su.so:__1cP_AfxThreadEntry6Fpv_I_+0x100
/export/home/siebel/siebsrvr/mw/lib/libkernel32.so:__1cIMwThread6Fpv_v_+0x23c
/lib/libc.so.1:0xc57f8
% more stderrout_7762_23511113.txt
********** Internal heap ERROR 17112 addr=35dddae8 *********
***** Dump of memory around addr 35dddae8:
35DDCAE0 00000000 00000000 [........]
35DDCAF0 00000000 00000000 00000000 00000000 [................]
Repeat 243 times
35DDDA30 00000000 00000000 00003181 00300020 [..........1..0. ]
35DDDA40 0949D95C 35D7A888 10003179 00000000 [.I.\5.....1y....]
35DDDA50 0949D95C 0949D8B8 35D7A89C C0000075 [.I.\.I..5......u]
...
...
******************************************************
HEAP DUMP heap name="Alloc environm" desc=949d8b8
extent sz=0x1024 alt=32767 het=32767 rec=0 flg=3 opc=2
parent=949d95c owner=0 nex=0 xsz=0x1038
EXTENT 0 addr=364fb324
Chunk 364fb32c sz= 4144 free " "
EXTENT 1 addr=364f8ebc
Chunk 364f8ec4 sz= 4144 free " "
EXTENT 2 addr=364f7d5c
Chunk 364f7d64 sz= 4144 free " "
EXTENT 3 addr=364f6d04
Chunk 364f6d0c sz= 4144 recreate "Alloc statemen " latch=0
ds 2c38df34 sz= 4144 ct= 1
...
...
EXTENT 406 addr=35ddda54
Chunk 35ddda5c sz= 116 free " "
Chunk 35dddad0 sz= 24 BAD MAGIC NUMBER IN NEXT CHUNK (6)
freeable assoc with mark prv=0 nxt=0
Dump of memory from 0x35DDDAD0 to 0x35DDEAE8
35DDDAD0 20000019 35DDDA5C 00000000 00000000 [ ...5..\........]
35DDDAE0 00000095 0000008B 00000006 35DDDAD0 [............5...]
35DDDAF0 00000000 00000000 00000095 35DDDB10 [............5...]
...
...
EXTENT 2080 addr=d067a6c
Chunk d067a74 sz= 2220 freeable "Alloc statemen " ds=2b0fffe4
Chunk d068320 sz= 1384 freeable assoc with mark prv=0 nxt=0
Chunk d068888 sz= 4144 freeable "Alloc statemen " ds=2b174550
Chunk d0698b8 sz= 4144 recreate "Alloc statemen " latch=0
ds 1142ea34 sz= 112220 ct= 147
223784cc sz= 4144
240ea014 sz= 884
28eac1bc sz= 900
2956df7c sz= 900
1ae38c34 sz= 612
92adaa4 sz= 884
2f6b96ac sz= 640
c797bc4 sz= 668
2965dde4 sz= 912
1cf6ad4c sz= 656
10afa5e4 sz= 656
2f6732bc sz= 700
27cb3964 sz= 716
1b91c1fc sz= 584
a7c28ac sz= 884
169ac284 sz= 900
...
...
Chunk 2ec307c8 sz= 12432 free " "
Chunk 3140a3f4 sz= 4144 free " "
Chunk 31406294 sz= 4144 free " "
Bucket 6 size=16400
Bucket 7 size=32784
Total free space = 340784
UNPINNED RECREATABLE CHUNKS (lru first):
PERMANENT CHUNKS:
Chunk 949f3c8 sz= 100 perm "perm " alo=100
Permanent space = 100
******************************************************
Hla: 255
ORA-21500: internal error code, arguments: [17112], [0x35DDDAE8], [], [], [], [], [], []
Errors in file :
ORA-21500: internal error code, arguments: [17112], [0x35DDDAE8], [], [], [], [], [], []
----- Call Stack Trace -----
NOTE:+offset is used to represent that the
function being called is offset bytes from
the _PROCEDURE_LINKAGE_TABLE_.
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
F2365738 CALL+23052 D7974250 ? D797345C ? DD20 ?
D79741AC ? D79735F8 ?
F2ECD7A0 ?
F286DDB8 PTR_CALL 00000000 949A018 ? 14688 ? B680B0 ?
F2365794 ? F2ECD7A0 ? 14400 ?
F286E18C CALL+77460 949A018 ? 0 ? F2F0E8D4 ?
1004 ? 1000 ? 1000 ?
F286DFF8 CALL+66708 949A018 ? 0 ? 42D8 ? 1 ?
D79743E0 ? 949E594 ?
...
...
__1cN_smiWorkQdDueu CALL __1cN_smiWorkQdDueu 1C8F608 ? 18F55F38 ?
30A5A008 ? 1A98E208 ?
FDBDF178 ? FDBE0424 ?
__1cQSmiThrdEntryFu PTR_CALL 00000000 1C8F608 ? FDBE0424 ?
1AB6EDE0 ? FDBDF178 ? 0 ?
1500E0 ?
__1cROSDWslThreadSt PTR_CALL 00000000 1ABE8250 ? 600140 ? 600141 ?
105F76E8 ? 0 ? 1AC74864 ?
__1cP_AfxThreadEntr PTR_CALL 00000000 0 ? FF30A420 ? 203560 ?
1AC05AF0 ? E2 ? 1AC05A30 ?
__1cIMwThread6Fpv_v PTR_CALL 00000000 D7A7DF6C ? 17F831E0 ? 0 ? 1 ?
0 ? 17289C ?
_lwp_start()+0 ? 00000000 1 ? 0 ? 1 ? 0 ? FCE6C710 ?
1AC72680 ?
----- Argument/Register Address Dump -----
Argument/Register addr=d7974250. Dump of memory from 0xD7974210 to 0xD7974350
D7974200 0949A018 00014688 00B680B0 F2365794
D7974220 F2ECD7A0 00014400 D7974260 F286DDB8 800053FC 80000000 00000002 D79743E0
D7974240 4556454E 545F3231 35303000 32000000 F23654D4 F2365604 00000000 0949A018
D7974260 00000000 0949A114 0000000A F2ECD7A0 FC873504 00001004 F2365794 F2F0E8D4
D7974280 0949A018 00000000 F2F0E8D4 00001004 00001000 00001000 D79742D0 F286E18C
D79742A0 F6CB7400 FC872CC0 00000004 00CDE34C 4556454E 545F3437 31313200 00000000
D79742C0 00000000 00000001 D79743E0 00000000 F2F0E8D4 00001004 00001000 00007530
D79742E0 00007400 00000001 FC8731D4 00003920 0949A018 00000000 000042D8 00000001
D7974300 D79743E0 0949E594 D7974330 F286DFF8 D7974338 F244D5A8 00000000 01000000
D7974320 364FBFFF 01E2C000 00001000 00000000 00001000 00000000 F2ECD7A0 F23654D4
D7974340 000000FF 00000001 F2F0E8D4 F25F9824
Argument/Register addr=d797345c. Dump of memory from 0xD797341C to 0xD797355C
D7973400 F2365738
...
...
Argument/Register addr=1eb21388. Dump of memory from 0x1EB21348 to 0x1EB21488
1EB21340 00000000 00000000 FE6CE088 FE6CE0A4 0000000A 00000010
1EB21360 00000000 00000000 00000000 00000010 00000000 00000000 00000000 FEB99308
1EB21380 00000000 00000000 00000000 1C699634 FFFFFFFF 00000000 FFFFFFFF 00000001
1EB213A0 00000000 00000000 00000000 00000000 00000081 00000000 F16F1038 67676767
1EB213C0 00000000 FEB99308 00000000 00000000 FEB99308 FEB46EF4 00000000 00000000
1EB213E0 00000000 00000000 FEB99308 00000000 00000000 00000001 0257E3B4 03418414
1EB21400 00000000 00000000 FEB99308 FEB99308 00000000 00000000 00000000 00000000
1EB21420 00000000 00000000 00000000 00000000 1EB213B0 00000000 00000041 00000000
1EB21440 0031002D 00410036 00510038 004C0000 00000000 00000000 00000000 00000000
1EB21460 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
1EB21480 00000109 00000000
----- End of Call Stack Trace -----
If you notice slight performance degradation of the application(s) on Solaris 10 8/07 compared to Solaris 10 1/06 & Solaris 10 11/06, it could be due to the conservative large page selection by the operating system. In S10 8/07, the maximum page size for heap/stack/mmap has been reduced to 64K (default is up to 256M depending on the underlying hardware -- eg., 256M on Niagara (US-T1)/US-IV+/SPARC64-VI systems, 32M on US-IV systems and 4M on US-III+ systems) on all systems lacking page coloring. 4M is the default maximum page size on US-T2 (Niagara2) systems. You can check this with the help of pmap -sx <pid>
. I do not know exactly the motivation for this change, but I'm suspecting that bugs like default_physio/as_pagelock scales poorely with threads doing IO have something to do with this change.
max_uheap_lpsize
and mmu_ism_pagesize
for the system wide large page usage.MPSSHEAP
and MPSSSTACK
environment variablesMPSSHEAP=32M
MPSSSTACK=64K
LD_PRELOAD=$LD_PRELOAD:mpss.so.1
<application> <arg1> <arg2> .. <argn>
MPSSCFGFILE
to set the preferred page sizes for the heap and the stack. See Solaris 9 or later: More performance with Large Pages (MPSS) for an example.max_uheap_lpsize
to the desired maximum page size. Find the supported page sizes by running pagesize -a
. Solaris tries to use the supported page sizes {wherever it can} until the maximum page size set. For example, if /etc/system has set max_uheap_lpsize = 0x2000000
, Solaris tries to use a maximum page size of 32M although the system could use 256M pages.mmu_ism_pagesize
to the desired maximum page size. For example, if /etc/system has set mmu_ism_pagesize=0x200000
, Solaris tries to use a maximum page size of 4M although the system could use 32M and 256M pages.max_uheap_lpsize
need not be set, if mmu_ism_pagesize
has been set in /etc/system. Solaris kernel will change max_uheap_lpsize
and others to the value set in /etc/system for mmu_ism_pagesize
parameter, to be in sync with ism pagesize.set exec_lpg_disable=1
set use_brk_lpg=0
set use_stk_lpg=0
set use_zmap_lpg=0
set max_uheap_lpsize=0x2000
set max_ustack_lpsize=0x2000
set max_privmap_lpsize=0x2000
set size_t max_shm_lpsize=0x2000
set use_brk_lpg=0
set use_stk_lpg=0
ORA-01113: file x needs media recovery
Error.% sqlplus / as sysdba
SQL*Plus: Release 10.2.0.1.0 - Production on Mon Sep 24 09:29:10 2007
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to an idle instance.
SQL> startup
ORACLE instance started.
Total System Global Area 2684354560 bytes
Fixed Size 1981064 bytes
Variable Size 436209016 bytes
Database Buffers 2231369728 bytes
Redo Buffers 14794752 bytes
Database mounted.
ORA-01113: file 1 needs media recovery
ORA-01110: data file 1: '/OraData/SIAMST/siamst_system.dbf'
% oerr ora 01113
01113, 00000, "file %s needs media recovery"
// *Cause: An attempt was made to online or open a database with a file that
// is in need of media recovery.
// *Action: First apply media recovery to the file.
mount
optionSQL> startup mount
ORACLE instance started.
Total System Global Area 2684354560 bytes
Fixed Size 1981064 bytes
Variable Size 436209016 bytes
Database Buffers 2231369728 bytes
Redo Buffers 14794752 bytes
Database mounted.
SQL> SELECT MEMBER FROM V$LOG G, V$LOGFILE F WHERE G.GROUP# = F.GROUP#
2 AND G.STATUS = 'CURRENT';
MEMBER
--------------------------------------------------------------------------------
/OraRedo/RedoLogFiles/siamst_log01.dbf
SQL> RECOVER DATABASE USING BACKUP CONTROLFILE UNTIL CANCEL
ORA-00279: change 21375038 generated at 09/21/2007 20:12:47 needed for thread 1
ORA-00289: suggestion : /export/pspp/oracle/dbs/arch1_4_633901491.dbf
ORA-00280: change 21375038 for thread 1 is in sequence #4
Specify log: {=suggested | filename | AUTO | CANCEL}
/OraRedo/RedoLogFiles/siamst_log01.dbf
Log applied.
Media recovery complete.
RESETLOGS
mode. It is recommended to reset the online logs after incomplete recovery or recovery with a backup control fileSQL> ALTER DATABASE OPEN RESETLOGS;
Database altered.
# mkdir /export/home/ttaserv
# groupadd -g 102 ttaserv
# useradd -g 102 -d /export/home/ttaserv -s /bin/bash ttaserv
# useradd -g 102 -d /export/home/ttaserv -s /bin/bash ttasys
# pkgadd -d ./tta-4.31-905.sol-sparc.pkg
The following packages are available:
1 tta Sun Secure Global Desktop Software for SPARC Solaris 2.8+
(SPARC) 4.31.905
Select package(s) you wish to process (or 'all' to process
all packages). (default: all) [?,??,q]: all
Processing package instance <tta> from </export/home/oracle/tta-4.31-905.sol-sparc.pkg>
Sun Secure Global Desktop Software for SPARC Solaris 2.8+(SPARC) 4.31.905
Sun Microsystems, Inc.
--------------------------------------------------------------------------
Setting up Sun Secure Global Desktop Software
--------------------------------------------------------------------------
Secure Global Desktop Setup recommends you use the following settings:
Installation type = install 4.31.905
Installation directory = /opt/ttaserv
Are these settings OK?
Y - Yes, install using these settings
N - No, tell me more about the options and let me change the settings
Q - Quit now
OK to use these settings? [Y] N
--------------------------------------------------------------------------
Secure Global Desktop installation directory
--------------------------------------------------------------------------
Secure Global Desktop uses a single directory for all its code and other
static and dynamic components. Which directory would you like to use?
Installation directory [/opt/ttaserv] /export/home/ttaserv/
--------------------------------------------------------------------------
Setting up Sun Secure Global Desktop Software
--------------------------------------------------------------------------
Installation type = install 4.31.905
Installation directory = /export/home/ttaserv/
Are these settings OK?
Y - Yes, install using these settings
N - No, tell me more about the options and let me change the settings
Q - Quit now
OK to use these settings? [Y] Y
...
...
...
## Executing postinstall script.
To complete the installation, please run /export/home/ttaserv/bin/tarantella start
Installation of <tta> was successful.
# grep -i timeout vars.exp
# Timeouts
set timeouts(prelogin) 180
set timeouts(loggedin) 180
set timeouts(hostprobe) 180
set timeout 3600
# /export/home/ttaserv/bin/tarantella start
--------------------------------------------------------------------------
Secure Global Desktop Software License Agreement
--------------------------------------------------------------------------
To use Secure Global Desktop you must agree to be bound by
the terms of the Software License Agreement.
Y - I have read, and accept the terms of the license agreement
N - I do not accept the terms of the license agreement
R - Let me read the license agreement
Accept terms of Software License Agreement? [R] Y
--------------------------------------------------------------------------
Setting up Sun Secure Global Desktop Software
--------------------------------------------------------------------------
Secure Global Desktop Setup recommends you use the following settings:
Installation type = install 4.31.905
Peer DNS name = v490-a4
HTTP port = 80 [not currently in use]
Archive logs every week? = yes (Sunday 03:00 hours)
Are these settings OK?
Y - Yes, install using these settings
N - No, tell me more about the options and let me change the settings
Q - Quit now
OK to use these settings? [Y] N
--------------------------------------------------------------------------
Peer (internal) DNS name
--------------------------------------------------------------------------
Each computer on the network may have a number of DNS names. In
Secure Global Desktop, the peer DNS name is the name by which this host
is known to others within your firewall, if you have one. If you're
using an array of multiple Secure Global Desktop servers, this is the
name used by other servers in the array to identify this server.
Peer DNS name [v490-a4] dummy.sun.com
--------------------------------------------------------------------------
HTTP port
--------------------------------------------------------------------------
Secure Global Desktop includes a web server. You need to choose the TCP port
on which the web server listens for HTTP (unencrypted) connections.
The default port for HTTP is 80/tcp.
You must choose an unused TCP port for installation to complete.
HTTP port [80] 8000
--------------------------------------------------------------------------
Archive logs every week
--------------------------------------------------------------------------
Would you like the Secure Global Desktop server to archive its log files
every week?
Archive logs every week? [yes] yes
On what day should the archive occur?
Type a number between 0 (Sunday) and 6 (Saturday).
Archive day [0]
At what time should the archive occur?
Type a number between 0 (midnight) and 23 (11pm).
Archive time [03]
--------------------------------------------------------------------------
Setting up Sun Secure Global Desktop Software
--------------------------------------------------------------------------
Installation type = install 4.31.905
Peer DNS name = dummy.sun.com
HTTP port = 8000 [not currently in use]
Archive logs every week? = yes (Sunday 03:00 hours)
Are these settings OK?
Y - Yes, install using these settings
N - No, tell me more about the options and let me change the settings
Q - Quit now
OK to use these settings? [Y] Y
--------------------------------------------------------------------------
Configuring your installation...
Running templates Setup script...OK
Running files_rename Setup script...OK
Running dbcreate Setup script...OK
Running extended_templates Setup script...OK
Running config Setup script...OK
Running printing Setup script...OK
Running sysadmin Setup script...OK
Running loadprobe_config Setup script...OK
Configuring and starting Secure Global Desktop web server...OK
Running wcp/configchanges Setup script...OK
Running tsp/resources Setup script...OK
Running 3270/resources Setup script...OK
Running 3270/configchanges Setup script...OK
Running 3270/purge Setup script...OK
Running 5250/resources Setup script...OK
Running 5250/configchanges Setup script...OK
--------------------------------------------------------------------------
What's next?
--------------------------------------------------------------------------
Secure Global Desktop is now installed and ready to use.
To get started:
- In a web browser, go to:
http://dummy.sun.com:8000/
- When prompted, log in with username "Administrator" and root's password.
- On your webtop, click Administration Guide to learn more about the product
(we strongly recommend you read the "Getting started" section).
Or click Object Manager to start creating user webtops.
To add license keys, click Array Manager on your webtop or type:
/export/home/ttaserv/bin/tarantella license add <key>...
--------------------------------------------------------------------------
Successfully installed Sun Secure Global Desktop Software
--------------------------------------------------------------------------
# /export/home/ttaserv/bin/tarantella status
Array members (1):
- dummy.sun.com (primary): Accepting standard connections.
- Webtop sessions (0):
- Emulator sessions (0):
# /export/home/ttaserv/bin/tarantella status
Array members (1):
- dummy.sun.com (primary): Accepting standard connections.
- Webtop sessions (1):
- Standard connections: 1
- Emulator sessions (1):
- X Protocol Engine: 1
# /export/home/ttaserv/bin/tarantella stop
WARNING: Users are connected to this Secure Global Desktop server.
Stopping the server will shut down any emulator sessions for these users.
This may result in loss of data.
Are you sure you want to continue? [no] y
Secure Global Desktop services have been stopped.
# /export/home/ttaserv/bin/tarantella start
Starting Secure Global Desktop server (version 4.31.905). Please wait...
Secure Global Desktop services are now available on this host.
# /export/home/ttaserv/bin/tarantella webserver stop
Stopping Tomcat servlet container...
Using CLASSPATH: /export/home/ttaserv/webserver/tomcat/5.0.28_axis1.2/bin/bootstrap.jar:/export/home/ttaserv/bin/jdk.spso...
Using CATALINA_BASE: /export/home/ttaserv/webserver/tomcat/5.0.28_axis1.2
Using CATALINA_HOME: /export/home/ttaserv/webserver/tomcat/5.0.28_axis1.2
Using JAVA_HOME: /export/home/ttaserv/bin/jdk.spso_1.6.0
...OK
Stopping Apache web server...
/export/home/ttaserv/webserver/apache/1.3.36_mod_ssl-2.8.27_openssl-0.9.8d_jk1.2.15/bin/apachectl stop: httpd stopped
...OK
# /export/home/ttaserv/bin/tarantella status
Array members (1):
- dummy.sun.com (primary): NOT ACCEPTING CONNECTIONS.
# /export/home/ttaserv/bin/tarantella webserver start
Starting Tomcat servlet container...
Using CLASSPATH: /export/home/ttaserv/webserver/tomcat/5.0.28_axis1.2/bin/bootstrap.jar:/export/home/ttaserv/bin/jdk.spso ...
Using CATALINA_BASE: /export/home/ttaserv/webserver/tomcat/5.0.28_axis1.2
Using CATALINA_HOME: /export/home/ttaserv/webserver/tomcat/5.0.28_axis1.2
Using JAVA_HOME: /export/home/ttaserv/bin/jdk.spso_1.6.0
...OK
Starting Apache web server...
/export/home/ttaserv/webserver/apache/1.3.36_mod_ssl-2.8.27_openssl-0.9.8d_jk1.2.15/bin/apachectl start: httpd started
...OK
unzip
utility on Solaris, and it fails with the following error:cannot find zipfile directory in one of file.zip or
file.zip.zip, and cannot find file.zip.ZIP, period.
% ls -lh file.zip
-rw-r--r-- 1 oracle dba 13G Sep 8 09:46 file.zip
zipinfo
returns the following message:
$ zipinfo file.zip
[file.zip]
End-of-central-directory signature not found. Either this file is not
a zipfile, or it constitutes one disk of a multi-part archive. In the
latter case the central directory and zipfile comment will be found on
the last disk(s) of this archive.
zipinfo: cannot find zipfile directory in one of file.zip or
file.zip.zip, and cannot find file.zip.ZIP, period.
jar
tool that comes with the Java Development Kit (JDK). It may work.unzip
(there's no 64-bit version) cannot handle large files of size > 2GB or 4GB. I believe the 32-bit jar
tool was built with switches like -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64
to overcome limitations like the one discussed in this blog entry.grub
with system user privileges% sudo grub
Password:
Probing devices to guess BIOS drives. This may take a long time.
grub> find /boot/grub/stage1
(hd0,0)
grub> root (hd0,0)
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... yes
Checking if "/boot/grub/stage2" exists... yes
Checking if "/boot/grub/e2fs_stage1_5" exists... yes
Running "embed /boot/grub/e2fs_stage1_5 (hd0)"... 17 sectors are embedded.
succeeded
Running "install /boot/grub/stage1 (hd0) (hd0)1+17 p (hd0,0)/boot/grub/stage2
/boot/grub/menu.lst"... succeeded
Done.
Top 5 Timed Events
Event | Waits | Time(s) | Avg Wait(ms) | % Total Call Time | Wait Class |
---|---|---|---|---|---|
latch: cache buffers chains | 94,301 | 169,403 | 1,796 | 86.1 | Concurrency |
CPU time | 5,478 | 2.8 | |||
wait list latch free | 247,466 | 4,756 | 19 | 2.4 | Other |
buffer busy waits | 14,928 | 1,382 | 93 | .7 | Concurrency |
db file sequential read | 98,750 | 552 | 6 | .3 | User I/O |
cdump
directory, have a look at the corresponding stack traces generated in udump
directory. If the call stack looks similar to the following stack, apply Oracle server patch 5666714 to overcome this problem.
Errors in file /opt/oracle/admin/VIS/udump/vis_ora_1040.trc:
ORA-07445: exception encountered: core dump [SIGSEGV] [Address not mapped to object] [2168] [] [] []
Fri Jun 15 01:30:38 2007
Errors in file /opt/oracle/admin/VIS/udump/vis_ora_1040.trc:
ORA-07445: exception encountered: core dump [SIGSEGV] [Address not mapped to object] [9] [] [] []
ORA-07445: exception encountered: core dump [SIGSEGV] [Address not mapped to object] [2168] [] [] []
Fri Jun 15 01:30:38 2007
Errors in file /opt/oracle/admin/VIS/udump/vis_ora_1040.trc:
ORA-07445: exception encountered: core dump [SIGSEGV] [Address not mapped to object] [9] [] [] []
ORA-07445: exception encountered: core dump [SIGSEGV] [Address not mapped to object] [9] [] [] []
ORA-07445: exception encountered: core dump [SIGSEGV] [Address not mapped to object] [2168] [] [] []
% more vis_ora_1040.trc
...
...
*** 2007-06-15 01:30:38.403
*** SERVICE NAME:(VIS) 2007-06-15 01:30:38.402
*** SESSION ID:(1111.4) 2007-06-15 01:30:38.402
Exception signal: 11 (SIGSEGV), code: 1 (Address not mapped to object), addr: 0x878
*** 2007-06-15 01:30:38.403
ksedmp: internal or fatal error
ORA-07445: exception encountered: core dump [SIGSEGV] [Address not mapped to object] [2168] [] [] []
Current SQL statement for this session:
INSERT /*+ IDX(0) */ INTO "INV"."MLOG$_MTL_SUPPLY" (dmltype$$,old_new$$,snaptime$$,change_vector$$,m_row$$) VALUES (:d,:o,to_
date('4000-01-01:00:00:00','YYYY-MM-DD:HH24:MI:SS'),:c,:m)
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
ksedst()+23 ? 0000000000000001 00177A9EC 000000000 0061D0A60
000000000
ksedmp()+636 ? 0000000000000001 001779481 000000000 00000000B
000000000
ssexhd()+729 ? 0000000000000001 000E753CE 000000000 0061D0B90
000000000
_sigsetjmp()+25 ? 0000000000000001 0FDDCB7E6 0FFFFFD7F 0061D0B50
000000000
call_user_handler() ? 0000000000000001 0FDDC0BA2 0FFFFFD7F 0061D0EF0
+589 000000000
sigacthandler()+163 ? 0000000000000001 0FDDC0D88 0FFFFFD7F 000000002
000000000
kglsim_pin_simhp()+ ? 0000000000000001 0FFFFFFFF 0FFFFFFFF 00000000B
173 000000000
kxsGetRuntimeLock() ? 0000000000000001 001EBF830 000000000 005E5D868
+683 000000000
kksfbc()+7361 ? 0000000000000001 001FB60A6 000000000 005E5D868
000000000
opiexe()+1691 ? 0000000000000001 0029045D0 000000000 0FFDF9250
0FFFFFD7F
opiall0()+1316 ? 0000000000000001 0028E9FB9 000000000 000000001
000000000
opikpr()+536 ? 0000000000000001 00290B2DD 000000000 0000000B7
000000000
opiodr()+1087 ? 0000000000000001 000E7BE1C 000000000 000000001
000000000
rpidrus()+217 ? 0000000000000001 000E8058E 000000000 0FFDFA6B8
0FFFFFD7F
skgmstack()+163 ? 0000000000000001 003F611D0 000000000 005E5D868
000000000
rpidru()+129 ? 0000000000000001 000E808A6 000000000 005E6FAD0
000000000
rpiswu2()+431 ? 0000000000000001 000E7FD8C 000000000 0FFDFB278
0FFFFFD7F
kprball()+1189 ? 0000000000000001 000E86E6A 000000000 0FFDFB278
0FFFFFD7F
kntxslt()+3150 ? 0000000000000001 0030601F3 000000000 005F7C538
000000000
kntxit()+998 ? 0000000000000001 003058EBB 000000000 005F7C538
000000000
0000000001E4866E ? 0000000000000001 001E4864B 000000000 000000000
000000000
delrow()+9170 ? 0000000000000001 0032020B7 000000000 000000002
000000000
qerdlFetch()+640 ? 0000000000000001 0033545F5 000000000 0EF38B020
000000003
delexe()+909 ? 0000000000000001 0032034EA 000000000 005E6FC50
000000000
opiexe()+9267 ? 0000000000000001 002906368 000000000 000000001
000000000
opiodr()+1087 ? 0000000000000001 000E7BE1C 000000000 0FFDFCD10
0FFFFFD7F
ttcpip()+1168 ? 0000000000000001 003D031AD 000000000 0FFDFEDF4
0FFFFFD7F
opitsk()+1212 ? 0000000000000001 000E77C41 000000000 000E7BA00
000000000
opiino()+931 ? 0000000000000001 000E7B0D8 000000000 005E5B8F0
000000000
opiodr()+1087 ? 0000000000000001 000E7BE1C 000000000 000000000
000000000
opidrv()+748 ? 0000000000000001 000E76A11 000000000 0FFDFF6D8
0FFFFFD7F
sou2o()+86 ? 0000000000000001 000E73E6B 000000000 000000000
000000000
opimai_real()+127 ? 0000000000000001 000E3A7C4 000000000 000000000
000000000
main()+95 ? 0000000000000001 000E3A694 000000000 000000000
000000000
0000000000E3A4D7 ? 0000000000000001 000E3A4DC 000000000 000000000
000000000
--------------------- Binary Stack Dump ---------------------
========== FRAME [1] (ksedst()+23 -> 0000000000000001) ==========
Dump of memory from 0x00000000061D0910 to 0x00000000061D0920
0061D0910 061D0920 00000000 0177A9EC 00000000 [ .........w.....]
========== FRAME [2] (ksedmp()+636 -> 0000000000000001) ==========
Dump of memory from 0x00000000061D0920 to 0x00000000061D0A60
0061D0920 061D0A60 00000000 01779481 00000000 [`.........w.....]
0061D0930 0000000B 00000000 061D0EF0 00000000 [................]
0061D0940 05E5B96C 00000000 05E5C930 00000000 [l.......0.......]
0061D0950 05E5C930 00000000 FE0D2000 FFFFFD7F [0........ ......]
0061D0960 061D0A40 00000000 00000000 00000000 [@...............]
0061D0970 00000000 00000000 00000000 00000000 [................]
...
...
opatch lsinventory
on your database server.% opatch lsinventory_______________
Invoking OPatch 10.2.0.1.0
Oracle interim Patch Installer version 10.2.0.1.0
Copyright (c) 2005, Oracle Corporation. All rights reserved..
Oracle Home : /oracle/product/10.1.0
Central Inventory : /export/home/oracle/oraInventory
from : /oracle/product/10.1.0/oraInst.loc
OPatch version : 10.2.0.1.0
OUI version : 10.2.0.1.0
OUI location : /oracle/product/10.1.0/oui
Log file location : /oracle/product/10.1.0/cfgtoollogs/opatch/opatch-2007_Aug_10_21-56-03-PDT_Fri.log
Lsinventory Output file location : /oracle/product/10.1.0/cfgtoollogs/opatch/lsinv/lsinventory-2007_Aug_10_21-56-03-PDT_Fri.txt
--------------------------------------------------------------------------------
Installed Top-level Products (3):
Oracle Database 10g 10.2.0.1.0
Oracle Database 10g Products 10.2.0.1.0
Oracle Database 10g Release 2 Patch Set 1 10.2.0.2.0
There are 3 products installed in this Oracle Home.
Interim patches (2) :
Patch 4770693 : applied on Thu Aug 02 15:27:23 PDT 2007
Created on 12 Jul 2006, 11:52:39 hrs US/Pacific
Bugs fixed:
4770693
Patch 5666714 : applied on Fri Jul 20 10:21:33 PDT 2007
Created on 29 Nov 2006, 04:52:58 hrs US/Pacific
Bugs fixed:
5666714
--------------------------------------------------------------------------------
OPatch succeeded.