|
请使用QQ关联注册PLM之家,学习更多关于内容,更多精彩原创视频供你学习!
您需要 登录 才可以下载或查看,没有账号?注册
x
http://www-cad.fnal.gov/PLMWorld2008/Teamcenter%20Unified/The%2520Network%2520is%2520Slow!.pdf # _& m' o1 b& e" v! I& p; u# m
http://www.plmworld.org/p/bl/et/blogid=43&blogaid=218
" U0 c3 _) f3 u5 M" a1 i" ihttps://support.industrysoftware.automation.siemens.com/docs/teamcenter/Network_Performance_Tuning_V6.6.pdf
7 P. {+ c; i3 Z* D6 J% S1 o$ V$ \$ Q" G d0 P% M; |7 w
Teamcenter is Slow! Teamcenter Performance Bottlenecks & Mitigation
( I+ Q1 l6 z7 z3 l: W! H" W R
, [( J( _1 v/ o* Z3 f& d, a, BLarry Carpenter8 K" O" V# C6 @4 n* s1 B
At the Chicago-Wisconsin RUG Fall Conference in October 2012, I gave a presentation on common Teamcenter performance issues and solutions along with listing, in one place, many other past Teamcenter performance presentations and white papers. It was very well received by a standing room crowd, so I thought I'd share it with the rest of the PLM World community. Here is a link to the presentation (you must be a TCUA SIG member to view it): http://www.plmworld.org/p/do/sd/sid=3758&type=0+ I0 n. Z5 B* x, X, d/ ]
For those unwilling to join the TcUA SIG to view it, I wrote an abbreviated version here:/ r4 ? S' |1 ~5 W& `0 P
Why Performance Matters" Y/ Y0 e2 a* o5 Z. U
• Productivity – doing more work with less
0 L8 V# {5 Y8 P' t0 O' Wo Improve end user productivity
; |6 U) `& ~3 @2 S1 yo Improves administrator productivity7 h/ A! e2 V L- R
fewer help desk calls responding to or fixing preventable problems
3 P: c% u* e% e* w) `• Reliability2 M9 h+ `: u6 S- p
o A well tuned Teamcenter environment also improves system stability and uptime.; V' n( a% E5 M/ E
o Less opportunity for data corruption* K8 j# n/ [$ }0 _% Z7 j
o Fewer operational errors/problems$ v) y" K3 g/ G2 [
• Cost Savings" T, T* C3 K' q0 e8 K$ |# m
o Less waiting means less time wasted.! ^+ o9 B* Z: S* t' L
Quick Case Study: Company ‘S’
7 v& g, N" r+ L7 E$ xPerformance was so bad that something which used to take 10 minutes was taking 2 hours to do.Did pretty much everything wrong, performance-wise, at first but ultimately fixed every major problem. What took 2 hours now only takes 2 minutes.
1 i: n4 S. n3 A7 f. b( H1 d- q! \See my March 2012 article on PLM World’s website for details:/ e* m+ b6 C9 K- X0 _+ u y& \( ^
Teamcenter Performance – Hard-Earned Lessons: http://www.plmworld.org/p/bl/ar/blogaid=152
6 x% }& f' R5 \, E% {7 T" yCommon Performance Bottleneck Causes; W3 B6 o$ ]* e8 I9 a
Using OOTB settings — OOTB settings are intended for development environments; not production environments.- Z$ t, v: q/ F% t- \" Y
Overloaded servers — Putting too much on a single server.; ~ O" {0 |4 v5 j) O
Operating system settings — Network settings most common (e.g. TCP parameters).
: @# `- W, g5 VLack of performance monitoring & tuning — Performance doesn’t improve all by itself. It requires human intervention to determine root cause and address it.
5 f' m' `$ w* }) Q8 f* KDatabases – The Most Likely Culprit
7 W. A, Q5 A5 v& K' G& x• Database performance is highly sensitive to hardware, software, and DB configuration.
3 w0 |' m' u7 i/ O: I- j• DBAs at companies generally don’t do performance monitoring and tuning of your Teamcenter DB.
" ~. `" ^, v- S) u4 F3 K) s• It’s typically the last place that Teamcenter administrators look for performance issues rather than the first.( ?$ Q0 ?& A0 A' Z- e9 X) b3 W
Mitigating Database Server Bottlenecks
) P; e& D3 N: ^, p• Must use dedicated DB server
1 A# G6 C6 \* G Q3 A- Fo Do not use your DB server for anything other than your Teamcenter production database. This includes not serving additional databases from the same server.. ^6 F& a; ?( e! P0 q `
• Must have fast dedicated storage for DB files
! T$ T! O6 \2 I, J; {+ q2 ro Avoid using a NAS device; especially a shared NAS. Use DAS (Direct Attached Storage) instead.
% o9 f( c* `8 m- M% Lo Use multiple fast disk spindles partitioned with proper RAID levels according to the DB vendor & SPLM recommendations.
6 u' k8 ]. V9 [4 |. o4 ~4 Go Split DB data, temp, and log files across those RAID partitions according to DB vendor & SPLM recommendations.
) z, F, p% v. E* L8 ao Use disk controllers with a battery/flash backed cache.
# v, s+ O: M: F3 e: |0 so Use multiple disk controllers if possible.% t, _$ E6 {3 S+ g7 M7 L
• Cram the RAM$ _" w) Y3 f$ ?! R7 Y O
o Ideally should be greater than the database size or in-memory footprint. Otherwise disk swapping/paging will occur.; Q2 d/ o, h2 K8 N2 h: {& z
• Use 64-bit OS & DB software
, W/ O- A' @- oo 32-bit software has severe limitations regardless of whether you use “/3G”, AWE, or PAE settings to access memory beyond 3-4G. It’s still a bottleneck.
2 M) P4 E' `' K8 I5 ?8 h• Use a good quality network adapter(s)
4 f) a( O( O$ z; e. ]6 y* `o Often overlooked as potential source of bottleneck (e.g. packets/sec limitations). Consider multiple NICs “trunked” for better throughput.
+ `* J6 Y% x+ p3 f' A# B• DB maintenance tasks
2 x- O3 o( j3 B8 C7 ~( B6 ]o Update statistics and rebuild indexes regularly.8 R, S" J5 s8 w3 T- r/ ]
Common Teamcenter Server Bottleneck Causes
" `( S) P# N" V• Overloaded Tc Servers
: W6 l; T" Q4 w' q' G; v6 J/ R& t4 t• Poor Web Tier Configuration* {( ? ~8 {% N5 q
• Poor FMS Configuration
8 c9 G. }( k5 I• Debugging Turned ON
& W2 V7 d8 }' A9 b0 ~2 z6 q- N: n• Rich Client using OOTB settings) K8 Y1 I' j7 u2 ~3 ?+ [$ k! g' e
‘Unload’ Overloaded Teamcenter Servers
o! f9 u' D D9 I' D3 z• Put Dispatcher modules on separate computers away from other Tc Servers.1 ]+ L9 T4 O. s
• Separate the Web & Enterprise tiers from the Tc Corporate and Volume servers.
5 t4 ~& ? N: T( | q8 D6 w. w• Use load balancing for Middle Tier & FMS:
- i: T9 E% a$ ko Use multiple Web/Enterprise Tier servers to open up potential hardware resource bottlenecks (e.g. CPU, RAM, network adapter I/O, disk I/O, MB bus, etc.).! c. G5 V2 [7 V/ E. A
o Set up multiple FSC cache servers to take load off busy volume servers/storage.! t+ L+ O w0 Q( ^
Web Tier Configuration
% C3 l! P" I$ T• Do not use port 80 or 8080" V- C& D" Q" B8 M9 U, G
o HTTP traffic on those ports is considered web browsing traffic and is therefore given lowest priority on any network. Can also cause randomly dropped connections.
4 k8 \3 u- G% {6 N* ^• Enable http compression if not using WAN acceleration
2 ?. u' D, D+ o0 J* \" ro Must be done on both web server and on clients to take effect.
( M u1 h/ h# c2 _; v* E• Change/tune OOTB settings for Web Server/App
4 c, Q+ S, i; So E.g. timeout values, max # of threads, Java memory, etc.5 a A& Z& N4 A- X6 g Q5 v
o Read tuning guides specific to your chosen web server/app" _! j, B* g4 p3 U# E4 _7 Y' r) w
• Scale it up or sideways: I# z( M, l8 O4 J! q9 a
o Add another web tier server, or increase # of work processes (e.g. Web Garden mode for IIS).
( x3 B1 d' {* e) U& m% s& Q9 zCommon FMS Bottleneck Causes
& r" ^- x v1 \# C• Data improperly routed
: z2 `+ I. I9 l' Mo E.g. Forcing data to go through a remote FSC server over a WAN and back again over the same WAN instead of simply pulling it directly from a nearby Volume/cache server.3 ^* q# g$ |" y0 H7 v$ f0 N4 |5 O
• Using OOTB settings/ v/ G4 j' m6 g. }
o For development purposes only, remember?
h# X' @. m% W% [• Missing client IP address subnets
! _: Y+ M+ h2 o6 f• No load balancing
( v' P' p$ f7 U, }/ e• Not using remote cache servers for WAN users4 e5 X$ ?2 R- o* I
• Not using remote volume servers for WAN users" C0 W5 D: U; E _: d
FMS Configuration& g3 w+ x4 M) J4 \1 N
• Ensure routing is correct
& r2 q- j5 L5 G! J/ ~# d# To Between multiple FSC groups via entry/exit/link parameters" j! M0 E8 ]# `' n$ ^/ U7 W
o Between clients and their assigned FSC servers by using complete and accurate ‘clientmap’ parameters for ALL clients.
) U3 X0 m- T7 J& ko Use correct transport algorithms for LAN and WAN users.+ J6 k9 x. H Q& Q
• Tune FSC/FCC cache settings w5 F6 B& y7 o# @# p: Q
o Simply picking a total read/write cache size is not enough.
) p+ x+ E& ?7 ko Read “Sizing the FMS fast cache” in the Teamcenter help documentation. There is also a FMS cache sizing tool available from the GTAC web site. Link to FMS Calculator
3 G1 o$ u4 {! h. w• Ensure correct client maps
5 \6 A/ s' ?; @o Determine ALL potential client IP address ranges and where they are located. Don’t forget to account for VPN IP addresses.
. H1 ?. {4 u6 {' eo Place client maps in the closest FSC group to their location.8 B: B) O: r2 M; w& M) ^7 j0 x' O& J
• Use multiple FSCs for load balancing+ b0 J% D6 ?9 ~& @0 w& V6 e
o Use “front-end” FSC cache servers to reduce load on Volume servers. (Requires disabling of FSC direct routing)1 z& B8 l" ~& h4 Q( w7 B
o Use redundant FSC cache servers to load balance each other. Also provides fail-over.9 P( ~9 ]) I H) m
• Place FSC cache servers close to users4 @9 N. W* P4 A9 d5 }
o Greatly improves read performance (load time) over a WAN for groups consuming shared data.* j% j& ]3 T: x1 V+ K/ c' ~# T1 k2 U. e
• Place Volume servers close to users
+ n, _% _. \( U, [7 V0 B) xo Use Store & Forward or at least place remote volumes near remote users. (Backups of remote volumes are critical)
0 d, \7 I- R' W! n. h, Ao Greatly improve write performance (save time) over a WAN especially for CAD data.* ?. i3 [, t9 a, F7 Y
• Prepopulate FSC caches
: `3 @0 M8 L0 x+ M" E# k/ v$ n4 _; Zo Run a nightly script to prepopulate shared data across FSC caches.1 r7 i# G" D& \/ G. {
Misc Teamcenter Changes
5 K5 s" p% A2 W0 q4 E/ e& Q• Disable logging and other debugging tools. Turn them on only when needed. Examples,
: j% V8 b, ~( }1 Oo TC_SECURITY_LOGGING=OFF/ j/ S: h ]' O1 @- [
o TC_APPLICATION_LOGGING=OFF( P% C) L" k2 c: Q, F, y9 a
o TC_SLOW_SQL=-1
; J. p4 b4 e; }, F# R• Rich Client ‘Teamcenter.ini’ configuration:( y9 y2 ` {& u# o, W$ f
o Modify Teamcenter.ini file to increase Java Memory and other settings. Will improve performance/stability when perform large operations (CAD, PSE expansion, large Workflows).4 g8 ^/ h( d# f3 U. u2 P2 |
• Enable FCC File Warming
& A' g7 z7 U1 f, oo Improve startup time by having FCC and Tc files pre-loaded at OS login./ p' C# }) I* \3 O
Network Performance! L4 w) n# o2 C6 _+ Q1 | n
• Use a hardware-based WAN accelerator if using Teamcenter between multiple facilities over a WAN.
1 ~6 P: _6 s: D2 f; s3 po If none then make best use of software-based Web server and FMS WAN acceleration settings. (i.e. http compression & FMS compression)
* z- ]( \2 r: K! K• Optimize OS network settings( p' m; f) l3 b# u5 O" ?
o OOTB settings are insufficient% `: e: k6 L" i0 |, b
o Applies to both servers and clients
# e# G' N) w/ W4 Y* eo Examples, increasing # of tcp ports, disabling NAGLE algorithm, increasing buffer sizes, trunking multiple NICs, enabling Compound TCP, Large Windows Scaling9 q. L" A' B, W5 q% r
Recommended Server Changes (Windows)6 S( [( f. r1 N! K* ?
See Presentation." i5 g$ K0 h, g* L+ j, T
Recommended Client Changes (Windows)7 p- W( T- p1 F- N" \* {
See Presentation.) q( h* w9 H* h) o( [/ i5 ?
Performance Monitoring Tools+ r; Q2 D4 [4 w9 b* _ ~
• Some useful performance monitoring tools:
! z) }9 k7 J8 R/ T• Performance Monitor (comes with Windows)
0 q8 U- A \; q• Used to monitor OS, Teamcenter, and SQL use of resources( f$ a$ Y9 s/ w% c0 D3 c
• Wireshark (freeware network packet sniffer)& C0 ?" z: @% u) b- J
• Used to help identify network TCP performance between computers.- l8 I9 B) d; P7 J5 y
• Available at http://www.wireshark.org/
$ O, u' P. y0 y& [# p" T: z& E• Sysinternals Suite (free from Microsoft web site)- ^% p$ ^1 Y( ]$ l ]0 o. t. f
• http://technet.microsoft.com/en-us/sysinternals/bb842062( Q4 Y/ L+ Z# }
Reference Materials* ^3 J3 ?! N$ s/ P
• Available on GTAC Web Site @ http://support.industrysoftware.automation.siemens.com/docs/teamcenter/
; v0 |) \/ u' t0 J: No Teamcenter Deployment Guide! M) }1 E( B7 q1 J4 M/ V- i
o Teamcenter Network Performance Tuning; g7 r. P7 C* i% v% R/ j
o JBoss 4.2.2 Installation & Tuning Guide
8 L) m" s/ [+ N3 |o Optimizing Teamcenter Client Performance
" e* Q$ }* e* O \% eo Teamcenter System Performance Analysis! @( w6 m9 q9 n% u
• Oracle documentation & web sites
5 O% J7 o9 h2 w7 ]/ H• MS SQL Server documentation in addition to:
; }/ a _+ ~0 h# do Best Practices for Running Siemens Teamcenter on SQL Server+ J0 U! E2 U$ R; r3 `( y
http://download.microsoft.com/download/7/3/6/7365D2BB-BB34-4D28-A128-F2C8FBA6E995/Siemens-Teamcenter-and-SQL-Server-Best-Practices.pdf) v; j/ H3 Z$ a
o Siemens Blog on Technet z. y* U% E; S9 v! J6 W, _
http://blogs.technet.com/b/sql_server_isv/archive/tags/siemens/6 B" l2 M3 ^" |2 U% f
o Siemens-Teamcenter-SQL-Resource-Page; _ w- ~& q. P0 @! A* H- X9 w
http://blogs.technet.com/b/sql_server_isv/p/siemens-teamcenter-sql-server-resource-page.aspx2 U. b! J& U( `
• Past PLM World Conference Presentations available at www.plmworld.org,7 s, e" E4 Q9 ? O/ Y& [2 B" l% @
o Teamcenter 4-Tier Deployment – Best Practices2 C0 s1 X* [& Y' ~3 H& f4 q
o Teamcenter – Database Performance# B' q; J% U G+ [" X4 A
o JBoss Optimization for Teamcenter
: }8 k c! K, P7 q3 `$ lo Optimizing Teamcenter Client Performance3 v2 q, s# C' o5 K$ s
o Teamcenter Database Server Configuration & Tuning, j. L- ?1 m: v# m2 m
Contact Information3 {; B' q( x4 @4 s
Larry Carpenter P.E., PLM World Teamcenter SIG Chair, tcua@plmworld.org
& j y" H. E) F* w$ QTeamcenter UA SIG: http://www.plmworld.org/TC_UA
/ }8 q! t9 Y$ h7 \% XLinkedIn: http://www.linkedin.com/pub/larry-carpenter-pe/44/5b8/aaa" n( m6 T. u4 k0 Q& |+ i2 J9 u$ ~( m1 N
Alternate Contact Info: ideas2nx@plmworld.org, larry.carpenter@siemens.com5 I4 K' p4 B" C/ @' r
, C( H! F' E$ n0 j2 C |
|