|
请使用QQ关联注册PLM之家,学习更多关于内容,更多精彩原创视频供你学习!
您需要 登录 才可以下载或查看,没有账号?注册
x
http://www-cad.fnal.gov/PLMWorld2008/Teamcenter%20Unified/The%2520Network%2520is%2520Slow!.pdf
; M" c* {* r7 S. U3 J; z hhttp://www.plmworld.org/p/bl/et/blogid=43&blogaid=218 ) S7 ~3 B9 e$ d4 k! c
https://support.industrysoftware.automation.siemens.com/docs/teamcenter/Network_Performance_Tuning_V6.6.pdf) b0 I E* e4 V" t: X6 z$ U, O
7 B" H# `; e# l% A! I
Teamcenter is Slow! Teamcenter Performance Bottlenecks & Mitigation
7 C& Y( K* L8 D 4 ]0 `/ u; F; b3 V' N6 k F
Larry Carpenter
$ f: O W! J- @3 t, jAt the Chicago-Wisconsin RUG Fall Conference in October 2012, I gave a presentation on common Teamcenter performance issues and solutions along with listing, in one place, many other past Teamcenter performance presentations and white papers. It was very well received by a standing room crowd, so I thought I'd share it with the rest of the PLM World community. Here is a link to the presentation (you must be a TCUA SIG member to view it): http://www.plmworld.org/p/do/sd/sid=3758&type=04 d3 q' c4 O6 {" M
For those unwilling to join the TcUA SIG to view it, I wrote an abbreviated version here:& u$ d" p0 _' x4 a
Why Performance Matters
7 j4 [: a! i/ f0 v• Productivity – doing more work with less* K+ i& N. L9 }- _6 z% J" h
o Improve end user productivity
( B% b4 x) t" `- m$ h0 _- O0 x: no Improves administrator productivity& g- {0 \0 t* ^
fewer help desk calls responding to or fixing preventable problems+ y* w6 c; j7 Q, w% {0 _
• Reliability7 \6 z' V+ L- g3 [0 O7 F
o A well tuned Teamcenter environment also improves system stability and uptime.
- m' M) U2 S* s/ t: @0 ~o Less opportunity for data corruption' ]6 S, v# W6 Z; \
o Fewer operational errors/problems
# K4 e1 t, Q; v/ c% g. I* ~• Cost Savings
0 _6 ?' u7 L% z0 b( ^o Less waiting means less time wasted.; k: [6 u# p8 `' E* P. q/ G- ~
Quick Case Study: Company ‘S’
8 x; y- H2 I5 s/ C! D; P- R! B; ?Performance was so bad that something which used to take 10 minutes was taking 2 hours to do.Did pretty much everything wrong, performance-wise, at first but ultimately fixed every major problem. What took 2 hours now only takes 2 minutes.
! V- ~* e- p8 [See my March 2012 article on PLM World’s website for details:! F! d. a! k# i; V$ k; {; ]; u! x
Teamcenter Performance – Hard-Earned Lessons: http://www.plmworld.org/p/bl/ar/blogaid=152! L7 I& b, T! U
Common Performance Bottleneck Causes5 d' s. ~8 l' r& v# H
Using OOTB settings — OOTB settings are intended for development environments; not production environments.
' V3 J3 L5 h4 A: g+ j6 r, vOverloaded servers — Putting too much on a single server.# Y7 W8 Y6 B8 I; b6 {' v
Operating system settings — Network settings most common (e.g. TCP parameters).% X6 V, I2 o5 L' d
Lack of performance monitoring & tuning — Performance doesn’t improve all by itself. It requires human intervention to determine root cause and address it.
9 l7 a! M B' ?. o |7 PDatabases – The Most Likely Culprit. E9 G( \; ~8 q9 x# d7 U
• Database performance is highly sensitive to hardware, software, and DB configuration.( q; N5 x# |; M: q( y- Z7 E7 C
• DBAs at companies generally don’t do performance monitoring and tuning of your Teamcenter DB., L/ j. ~9 Z! z' }4 M
• It’s typically the last place that Teamcenter administrators look for performance issues rather than the first.
* V5 M2 V8 u4 y& RMitigating Database Server Bottlenecks
, x: [: m7 B" d6 Z2 b' [• Must use dedicated DB server
# {+ }3 M2 M, V C8 bo Do not use your DB server for anything other than your Teamcenter production database. This includes not serving additional databases from the same server.
b) {% e: H: p& V% ^• Must have fast dedicated storage for DB files
3 A& H" u; b3 O. I: q, Io Avoid using a NAS device; especially a shared NAS. Use DAS (Direct Attached Storage) instead.
_4 n+ E/ X5 F8 S* n3 I* g' n7 L' Ho Use multiple fast disk spindles partitioned with proper RAID levels according to the DB vendor & SPLM recommendations.8 ?9 q0 f" n F
o Split DB data, temp, and log files across those RAID partitions according to DB vendor & SPLM recommendations.
( W& @5 r- @* | W# e3 yo Use disk controllers with a battery/flash backed cache.
9 a. ] @( v q1 c/ }% |3 g8 k' So Use multiple disk controllers if possible.
( r6 x& V: v8 ^$ ~6 c \: j• Cram the RAM
/ ~2 ~: P5 I1 q. n6 C3 Eo Ideally should be greater than the database size or in-memory footprint. Otherwise disk swapping/paging will occur.- t: h9 G1 B- J5 p, Z
• Use 64-bit OS & DB software
' \' \9 ?* I9 n. bo 32-bit software has severe limitations regardless of whether you use “/3G”, AWE, or PAE settings to access memory beyond 3-4G. It’s still a bottleneck.! }4 O C$ D. ?# K8 F
• Use a good quality network adapter(s)4 O+ p- Z; Y T0 M4 o2 Y' g$ P9 w
o Often overlooked as potential source of bottleneck (e.g. packets/sec limitations). Consider multiple NICs “trunked” for better throughput. j3 S4 ~4 |' T# x/ O
• DB maintenance tasks
' U8 T$ R. i5 ?o Update statistics and rebuild indexes regularly.
* y# P) B2 N2 g0 |# TCommon Teamcenter Server Bottleneck Causes
8 o3 s% N% @; x* K. i• Overloaded Tc Servers
0 _' U- i2 |' X2 K" Q2 j1 f• Poor Web Tier Configuration$ Y1 ?/ J- n: s1 p' r% y
• Poor FMS Configuration4 x& \, k) a$ b
• Debugging Turned ON
$ I/ K/ c0 V6 r• Rich Client using OOTB settings6 @# ?! K s' o
‘Unload’ Overloaded Teamcenter Servers- l) f" l( [9 h( K1 a
• Put Dispatcher modules on separate computers away from other Tc Servers.- _$ A7 G' @3 ]! }: m2 e
• Separate the Web & Enterprise tiers from the Tc Corporate and Volume servers.7 F$ ]$ d9 k# `- k0 ?0 [$ }
• Use load balancing for Middle Tier & FMS:
l. v2 o( Q9 H2 v4 K+ p0 ro Use multiple Web/Enterprise Tier servers to open up potential hardware resource bottlenecks (e.g. CPU, RAM, network adapter I/O, disk I/O, MB bus, etc.).
8 s3 Q; d* k- h1 c Zo Set up multiple FSC cache servers to take load off busy volume servers/storage.! s' H4 K8 R7 c+ [ S. I
Web Tier Configuration. d' V9 U* U) x; m2 p4 z
• Do not use port 80 or 80807 Q( C0 P y3 q( U
o HTTP traffic on those ports is considered web browsing traffic and is therefore given lowest priority on any network. Can also cause randomly dropped connections.
+ K% o! w" t& Y) q9 t" @. u" ~$ H N# \• Enable http compression if not using WAN acceleration$ L, [+ |; f! v* k
o Must be done on both web server and on clients to take effect.; ` w$ c# u' K6 N6 R( m) \6 U
• Change/tune OOTB settings for Web Server/App B2 ?, H7 h0 L4 [& ?
o E.g. timeout values, max # of threads, Java memory, etc.4 G" a9 d$ o* ~( m: W
o Read tuning guides specific to your chosen web server/app% k' u# u9 _3 T. q
• Scale it up or sideways4 V! u/ _8 E% H5 u V8 D+ `0 u7 Q
o Add another web tier server, or increase # of work processes (e.g. Web Garden mode for IIS).
/ }) C$ a' R5 a6 [/ g/ b6 gCommon FMS Bottleneck Causes
" f* ^0 L# R- ~) ?! N• Data improperly routed
% j1 O+ r6 }, z9 c9 do E.g. Forcing data to go through a remote FSC server over a WAN and back again over the same WAN instead of simply pulling it directly from a nearby Volume/cache server.
9 I1 C3 j1 f/ t4 H3 h3 G7 q5 H• Using OOTB settings
4 x8 P" Y3 a7 x' L7 W6 l! b$ Ko For development purposes only, remember?
H& U, |# ?/ C; X• Missing client IP address subnets5 T8 [6 x# O" Z- y5 F4 o) E* i4 K
• No load balancing5 U2 c N2 K6 N! T- z3 K; u
• Not using remote cache servers for WAN users
+ u$ z: G7 t3 ^/ V, |7 v2 h% i3 `• Not using remote volume servers for WAN users2 n8 I! u* q$ L& h3 @
FMS Configuration
0 `2 S6 {# l+ L) M4 ]1 N2 k( B• Ensure routing is correct
6 [; `; Y5 \- s, po Between multiple FSC groups via entry/exit/link parameters1 l$ B ?% z! U5 g0 ]. d' m, E- n
o Between clients and their assigned FSC servers by using complete and accurate ‘clientmap’ parameters for ALL clients.
+ r$ h9 ^: h$ mo Use correct transport algorithms for LAN and WAN users.+ I. I( @7 d Q
• Tune FSC/FCC cache settings
3 B' [1 c" z- Z) t4 r( X* n; C0 fo Simply picking a total read/write cache size is not enough.( k7 ^( u$ ~ [- f" T% R3 U
o Read “Sizing the FMS fast cache” in the Teamcenter help documentation. There is also a FMS cache sizing tool available from the GTAC web site. Link to FMS Calculator
& n; ~# i" P, D, p) k/ o0 L• Ensure correct client maps B+ Q' a% H! Q. K c7 r, ]0 f0 `
o Determine ALL potential client IP address ranges and where they are located. Don’t forget to account for VPN IP addresses.4 D: w! @, t' ^( E5 o% }2 U& Q* ]
o Place client maps in the closest FSC group to their location.
! }' Z5 T1 a$ A5 z" u: p• Use multiple FSCs for load balancing
; |- J1 x- B- ao Use “front-end” FSC cache servers to reduce load on Volume servers. (Requires disabling of FSC direct routing)7 U: H. p9 r+ }1 d' x7 `. G! V
o Use redundant FSC cache servers to load balance each other. Also provides fail-over.
: ~; _7 p4 n i% v$ N• Place FSC cache servers close to users
+ L) w5 K: S! vo Greatly improves read performance (load time) over a WAN for groups consuming shared data.% M- F( ~0 B" i- P' G! I
• Place Volume servers close to users
~% \' n* W' k/ z3 X/ ~3 Wo Use Store & Forward or at least place remote volumes near remote users. (Backups of remote volumes are critical)9 X) ?4 w* m H
o Greatly improve write performance (save time) over a WAN especially for CAD data.
& u" n4 c" i5 t6 g7 h+ c• Prepopulate FSC caches
/ S1 `( y% k6 Yo Run a nightly script to prepopulate shared data across FSC caches.3 |& U+ Y, `4 v5 D0 l
Misc Teamcenter Changes6 J: t* c1 ^' J' e H! B, y! |
• Disable logging and other debugging tools. Turn them on only when needed. Examples,
4 A4 d9 J8 x7 Bo TC_SECURITY_LOGGING=OFF- T+ P9 Y& K( {
o TC_APPLICATION_LOGGING=OFF
7 s+ _$ \: k- y* X' K) To TC_SLOW_SQL=-1
% y4 J$ n# _$ t6 ~2 ]! Q! o7 q* {8 D• Rich Client ‘Teamcenter.ini’ configuration:, e7 }2 I% w* L
o Modify Teamcenter.ini file to increase Java Memory and other settings. Will improve performance/stability when perform large operations (CAD, PSE expansion, large Workflows).
; n. p; _0 D$ A! n% [- N- X• Enable FCC File Warming$ [2 ^) g' H9 m; y5 |
o Improve startup time by having FCC and Tc files pre-loaded at OS login.
& G3 a& ?/ v" t' l* @$ b* S' v. f# hNetwork Performance
+ o6 R/ h- p( G8 y& X. P. g5 P• Use a hardware-based WAN accelerator if using Teamcenter between multiple facilities over a WAN.
8 w6 P9 Q# h5 f8 S- [# Zo If none then make best use of software-based Web server and FMS WAN acceleration settings. (i.e. http compression & FMS compression)
4 j7 y/ N9 ^- k V" b3 r• Optimize OS network settings7 z* P5 u8 K+ z5 @- {/ ^
o OOTB settings are insufficient3 O1 @" A* n6 p7 B% t
o Applies to both servers and clients1 a* D7 i# q' `8 N: v4 f2 E
o Examples, increasing # of tcp ports, disabling NAGLE algorithm, increasing buffer sizes, trunking multiple NICs, enabling Compound TCP, Large Windows Scaling; X$ x; C6 x: i- x' c, H
Recommended Server Changes (Windows)( l; u3 p W i' q0 s. J
See Presentation.
* ]* `% Q" M, Z% b) zRecommended Client Changes (Windows)
0 [9 F: g* `+ ], A6 |See Presentation.
3 Q0 p3 ]9 W% E6 h9 r' d6 [Performance Monitoring Tools/ x# j* T6 l2 m& x0 T; Q
• Some useful performance monitoring tools:, L' K5 X6 k% ~6 F
• Performance Monitor (comes with Windows)
2 K/ B( W7 k$ R% J% E! H9 y, L• Used to monitor OS, Teamcenter, and SQL use of resources. \1 ?* k% g x' ~5 e
• Wireshark (freeware network packet sniffer)
! _3 x2 b7 E/ l4 I ?• Used to help identify network TCP performance between computers.: o3 l6 w7 x' }* G6 P
• Available at http://www.wireshark.org/& M5 q6 U4 L8 e7 E
• Sysinternals Suite (free from Microsoft web site)
9 {8 r0 s: t/ D$ G7 `• http://technet.microsoft.com/en-us/sysinternals/bb842062
m1 K+ G' b; m7 u" AReference Materials
3 V) L7 G0 ]8 y• Available on GTAC Web Site @ http://support.industrysoftware.automation.siemens.com/docs/teamcenter/
- G- F1 m& B2 ]; Yo Teamcenter Deployment Guide
7 Z0 J- c" G. U5 S* }o Teamcenter Network Performance Tuning- [+ e- \. f3 ~) n# _' u2 d
o JBoss 4.2.2 Installation & Tuning Guide
/ y5 _! v) h( n. s; Do Optimizing Teamcenter Client Performance
: ^; a- W) f, b2 I8 go Teamcenter System Performance Analysis
4 Y, `" Z, L3 q) _) l! s2 E9 K4 @8 |• Oracle documentation & web sites5 k. I4 E0 n; T2 Y& g% v8 C" }
• MS SQL Server documentation in addition to:
0 A1 g( y t4 m) v# p* V- lo Best Practices for Running Siemens Teamcenter on SQL Server" d# g( Z/ Z4 r+ a& p9 z! Q( n
http://download.microsoft.com/download/7/3/6/7365D2BB-BB34-4D28-A128-F2C8FBA6E995/Siemens-Teamcenter-and-SQL-Server-Best-Practices.pdf: W$ l( L, p% S/ a6 C+ f$ [3 D
o Siemens Blog on Technet
6 `( {8 N* ~% H* D0 B& r http://blogs.technet.com/b/sql_server_isv/archive/tags/siemens/
6 ^& M2 t1 I6 v, d& |o Siemens-Teamcenter-SQL-Resource-Page. d/ Q: _4 }* x0 a+ W3 |" q
http://blogs.technet.com/b/sql_server_isv/p/siemens-teamcenter-sql-server-resource-page.aspx) W/ d0 O8 K, J7 P" K
• Past PLM World Conference Presentations available at www.plmworld.org,) _" I5 l, t8 ]4 Z* J% K3 N
o Teamcenter 4-Tier Deployment – Best Practices/ }. x" i `4 f V" w1 T5 z5 I
o Teamcenter – Database Performance
0 _+ M7 ?4 B2 \1 v9 go JBoss Optimization for Teamcenter3 x u5 X, Z1 ^$ q* f9 k
o Optimizing Teamcenter Client Performance% R) S' k( h% {* f, g
o Teamcenter Database Server Configuration & Tuning( g. a ~* Z" }
Contact Information
4 t1 T8 L* s- a* ?* Z! Y/ CLarry Carpenter P.E., PLM World Teamcenter SIG Chair, tcua@plmworld.org, T6 }2 h5 w5 U
Teamcenter UA SIG: http://www.plmworld.org/TC_UA# j' h, i# N. j+ x8 K% Q
LinkedIn: http://www.linkedin.com/pub/larry-carpenter-pe/44/5b8/aaa; T1 G7 z q9 H
Alternate Contact Info: ideas2nx@plmworld.org, larry.carpenter@siemens.com/ t; @( x( o9 M& `
6 Z7 U7 e3 T7 z2 z/ j# x* q6 C1 X' T |
|