|
请使用QQ关联注册PLM之家,学习更多关于内容,更多精彩原创视频供你学习!
您需要 登录 才可以下载或查看,没有账号?注册
x
http://www-cad.fnal.gov/PLMWorld2008/Teamcenter%20Unified/The%2520Network%2520is%2520Slow!.pdf
& G9 Z- W/ ` f, e* j) Ihttp://www.plmworld.org/p/bl/et/blogid=43&blogaid=218
! u) o) I$ T: Y8 nhttps://support.industrysoftware.automation.siemens.com/docs/teamcenter/Network_Performance_Tuning_V6.6.pdf. x! n* x4 O: z0 \; S- ?4 G- b
! ?1 m# L* q \, BTeamcenter is Slow! Teamcenter Performance Bottlenecks & Mitigation2 [& S. _, u+ S1 c& {8 N `; S
: f# m) a& ?. ~: M, v% G
Larry Carpenter
5 L n% R) @" CAt the Chicago-Wisconsin RUG Fall Conference in October 2012, I gave a presentation on common Teamcenter performance issues and solutions along with listing, in one place, many other past Teamcenter performance presentations and white papers. It was very well received by a standing room crowd, so I thought I'd share it with the rest of the PLM World community. Here is a link to the presentation (you must be a TCUA SIG member to view it): http://www.plmworld.org/p/do/sd/sid=3758&type=03 k+ b, ^% j3 u6 P* w; g0 o# G
For those unwilling to join the TcUA SIG to view it, I wrote an abbreviated version here:; K7 t+ c. Z1 c+ P- L
Why Performance Matters9 F% r: J1 n- k( z: ^' [1 J
• Productivity – doing more work with less
0 u& Z1 g, H; T& K1 m: @o Improve end user productivity
9 i! r4 b; j* m' _8 ]2 L vo Improves administrator productivity
% v* I/ P* [" R fewer help desk calls responding to or fixing preventable problems; R! x2 H& D7 r, B
• Reliability7 u/ }6 ]+ N3 I. P d
o A well tuned Teamcenter environment also improves system stability and uptime.. p! j+ S& e; M/ A6 c
o Less opportunity for data corruption; O5 L) w4 `4 h2 c! e
o Fewer operational errors/problems+ M$ x5 Z2 B9 {7 h& E- y
• Cost Savings8 _/ Q- P0 g4 |& k( ^$ m
o Less waiting means less time wasted.6 A+ B3 @! U g% o
Quick Case Study: Company ‘S’
2 N3 f/ r* j$ x" c$ b; ]Performance was so bad that something which used to take 10 minutes was taking 2 hours to do.Did pretty much everything wrong, performance-wise, at first but ultimately fixed every major problem. What took 2 hours now only takes 2 minutes.
, k+ z0 M* E; Z7 D0 bSee my March 2012 article on PLM World’s website for details:
4 w$ ^ o$ w2 T4 i) KTeamcenter Performance – Hard-Earned Lessons: http://www.plmworld.org/p/bl/ar/blogaid=152) d* d9 m" S+ ?. X$ V2 F c
Common Performance Bottleneck Causes5 V& K3 T& M2 a( \+ a. s$ k
Using OOTB settings — OOTB settings are intended for development environments; not production environments.
, Y8 t1 K- l. f( I- I# u! m$ mOverloaded servers — Putting too much on a single server.- `' T& V2 w% P/ D" J) W& p
Operating system settings — Network settings most common (e.g. TCP parameters).3 `" Q, T- u; V* Z- s. E: A9 b
Lack of performance monitoring & tuning — Performance doesn’t improve all by itself. It requires human intervention to determine root cause and address it.
# L: `/ W$ z7 r, A* oDatabases – The Most Likely Culprit
7 ?" ~, p: x5 g' U2 M• Database performance is highly sensitive to hardware, software, and DB configuration.
- } W7 d5 @3 } j$ Z- W. p/ r• DBAs at companies generally don’t do performance monitoring and tuning of your Teamcenter DB.
4 q# q/ K: x* `: n+ Q! r• It’s typically the last place that Teamcenter administrators look for performance issues rather than the first.) r% o6 C3 _! j6 B/ S: V$ H" _! A. I
Mitigating Database Server Bottlenecks
% m6 y8 J* v# d* B2 [• Must use dedicated DB server
8 I$ ~0 t( w1 Q' ko Do not use your DB server for anything other than your Teamcenter production database. This includes not serving additional databases from the same server.
, s5 j6 p) H* [0 S• Must have fast dedicated storage for DB files1 H1 x% c0 n) m: Q
o Avoid using a NAS device; especially a shared NAS. Use DAS (Direct Attached Storage) instead.5 ?1 L, p; M& y! W8 e$ b) Q
o Use multiple fast disk spindles partitioned with proper RAID levels according to the DB vendor & SPLM recommendations.+ Q9 v/ x4 n: D
o Split DB data, temp, and log files across those RAID partitions according to DB vendor & SPLM recommendations.
' A& [" c/ ^: h& Z4 c. l: mo Use disk controllers with a battery/flash backed cache.3 D" J& t/ Z: d& M$ I! t
o Use multiple disk controllers if possible." ` i8 b) s& `+ i
• Cram the RAM
9 X- |0 f" ~9 R5 w$ m: fo Ideally should be greater than the database size or in-memory footprint. Otherwise disk swapping/paging will occur.
% v0 b2 b: K7 ^+ [, T4 O• Use 64-bit OS & DB software5 {: v5 e2 p1 M# ^5 I
o 32-bit software has severe limitations regardless of whether you use “/3G”, AWE, or PAE settings to access memory beyond 3-4G. It’s still a bottleneck.9 W6 t1 `: T# v9 N" E; `
• Use a good quality network adapter(s)
. c/ s3 t. z7 \" vo Often overlooked as potential source of bottleneck (e.g. packets/sec limitations). Consider multiple NICs “trunked” for better throughput.
3 D6 ^7 h; S0 @• DB maintenance tasks$ F; r @& A3 ?5 E
o Update statistics and rebuild indexes regularly.
. ~2 e) O( a F# ECommon Teamcenter Server Bottleneck Causes
, i4 |' `+ [8 ^" }• Overloaded Tc Servers
! p# V2 B" O. y Z0 G) Z& o• Poor Web Tier Configuration7 M4 X1 w" r. w/ P( w
• Poor FMS Configuration) D |, @" g0 Z
• Debugging Turned ON6 E* H' b5 ]& O( a8 s) k+ I, S) x
• Rich Client using OOTB settings
! F& k- c% c# y/ A8 ^‘Unload’ Overloaded Teamcenter Servers
, z, C& G* I$ x. @• Put Dispatcher modules on separate computers away from other Tc Servers.9 k0 g2 P$ X/ v, H. m' C
• Separate the Web & Enterprise tiers from the Tc Corporate and Volume servers.; r( Z7 E" P) k4 w' N
• Use load balancing for Middle Tier & FMS:
" X8 E* A! f4 o) Eo Use multiple Web/Enterprise Tier servers to open up potential hardware resource bottlenecks (e.g. CPU, RAM, network adapter I/O, disk I/O, MB bus, etc.).9 G1 D& S B" V* V2 E
o Set up multiple FSC cache servers to take load off busy volume servers/storage.
& s2 K L8 P) k. U8 Z. }Web Tier Configuration
0 A$ h2 a' f! G$ x1 Q2 p- S, d9 v- y• Do not use port 80 or 8080
3 D$ X% x8 x: J1 q3 Q F$ g; Fo HTTP traffic on those ports is considered web browsing traffic and is therefore given lowest priority on any network. Can also cause randomly dropped connections.7 x+ q: P* C' q! m1 ]
• Enable http compression if not using WAN acceleration
m( @* h% I! w6 U4 C6 n5 io Must be done on both web server and on clients to take effect.5 ]# ^/ |& [; ]1 O# l
• Change/tune OOTB settings for Web Server/App/ T: R% w4 Z) O# K) c7 @
o E.g. timeout values, max # of threads, Java memory, etc.% r. r. W! F) F1 F) k+ q: D
o Read tuning guides specific to your chosen web server/app( p- D. } I M( S+ h& A
• Scale it up or sideways
* N& _0 M2 `2 g; ao Add another web tier server, or increase # of work processes (e.g. Web Garden mode for IIS).# C/ j% Z$ b. C6 }# i
Common FMS Bottleneck Causes! @' N7 D u- D; `' p8 H: Z! A( d8 i& `
• Data improperly routed
1 ~2 `* c' E, F I- t2 j& Xo E.g. Forcing data to go through a remote FSC server over a WAN and back again over the same WAN instead of simply pulling it directly from a nearby Volume/cache server.% ^! Q% r. @1 z- C0 o0 N# u f
• Using OOTB settings
) v6 A4 w. |3 ]2 [1 _o For development purposes only, remember?3 ?2 j: x; }7 | H1 Y) Z
• Missing client IP address subnets" U& d, z! D6 b0 J
• No load balancing$ w, D4 ?$ l, Q% }" o
• Not using remote cache servers for WAN users3 `7 A+ Z d( t8 l+ G' V+ y. i
• Not using remote volume servers for WAN users% i* {5 i2 P! {& j& E7 `
FMS Configuration
9 p4 y7 O, w+ O$ Z' i• Ensure routing is correct
$ X9 ^% D, G" Q6 x" Y5 I k+ ro Between multiple FSC groups via entry/exit/link parameters. {7 ~ m3 F# ~) Q. G
o Between clients and their assigned FSC servers by using complete and accurate ‘clientmap’ parameters for ALL clients.) W7 F S. o8 L% k) @7 a, c1 v; d
o Use correct transport algorithms for LAN and WAN users., W$ ]) Q* X0 Q- L! r
• Tune FSC/FCC cache settings+ X* t( ], Q- P6 y
o Simply picking a total read/write cache size is not enough.: J" N& w0 p9 \3 D+ Y
o Read “Sizing the FMS fast cache” in the Teamcenter help documentation. There is also a FMS cache sizing tool available from the GTAC web site. Link to FMS Calculator7 Z# a* h9 U4 A
• Ensure correct client maps
% \' v8 }! N. fo Determine ALL potential client IP address ranges and where they are located. Don’t forget to account for VPN IP addresses.
" E U) T: ]% Co Place client maps in the closest FSC group to their location." L) P1 s9 B L
• Use multiple FSCs for load balancing3 \ e( M* q; A/ Z$ c0 B+ _7 A
o Use “front-end” FSC cache servers to reduce load on Volume servers. (Requires disabling of FSC direct routing)
+ m1 L3 k& {/ p6 ko Use redundant FSC cache servers to load balance each other. Also provides fail-over.
9 b' \ N# A' \+ x7 s, {! [• Place FSC cache servers close to users! \( K( U) f6 I0 P0 ^! b6 g" i
o Greatly improves read performance (load time) over a WAN for groups consuming shared data., _9 d' D* ^3 u* A# V, r$ D
• Place Volume servers close to users
) f9 A: c( B7 K8 }0 V1 m3 Ho Use Store & Forward or at least place remote volumes near remote users. (Backups of remote volumes are critical)
7 o3 j! `; @8 a" s! I% x, Q3 So Greatly improve write performance (save time) over a WAN especially for CAD data.
: _" }/ Q+ q5 L6 Z! P7 ]' ^• Prepopulate FSC caches; c9 H. ^- w1 r" b* }2 e/ m; k
o Run a nightly script to prepopulate shared data across FSC caches.
. _: D, Z( N z0 W- q7 J& Q) Y6 AMisc Teamcenter Changes
8 }; e+ @4 e! w4 P# x0 a• Disable logging and other debugging tools. Turn them on only when needed. Examples,
$ F6 X, M% r0 _( q0 g3 [# Ao TC_SECURITY_LOGGING=OFF- [* L2 D0 J7 h- ^5 p
o TC_APPLICATION_LOGGING=OFF% A, x) d5 ?8 ~! r( k
o TC_SLOW_SQL=-1
* q s* G. m3 c& S# M• Rich Client ‘Teamcenter.ini’ configuration:
" t8 B2 z3 a b: Ro Modify Teamcenter.ini file to increase Java Memory and other settings. Will improve performance/stability when perform large operations (CAD, PSE expansion, large Workflows).1 j) K! C+ G) N+ w0 {: q6 c
• Enable FCC File Warming) H( ]" _) c0 x w# c
o Improve startup time by having FCC and Tc files pre-loaded at OS login.
. U9 R8 s* W; u. r% p* b/ Y0 K$ ^' {# nNetwork Performance
' ?* ? X: P! N$ p/ F9 C; ~• Use a hardware-based WAN accelerator if using Teamcenter between multiple facilities over a WAN.
0 h$ S7 Z" I! A& u1 H0 i6 j; ?o If none then make best use of software-based Web server and FMS WAN acceleration settings. (i.e. http compression & FMS compression)1 J- v; l$ C5 g
• Optimize OS network settings
% r: f. e v% L7 N' W! |6 lo OOTB settings are insufficient! N- C. q; J. Z% O6 q+ i/ Y; c
o Applies to both servers and clients
8 H; Q/ t' h9 z+ V' uo Examples, increasing # of tcp ports, disabling NAGLE algorithm, increasing buffer sizes, trunking multiple NICs, enabling Compound TCP, Large Windows Scaling4 O; c4 L3 F5 C$ f$ U, Z% @
Recommended Server Changes (Windows)6 `) i; m+ d9 R" y, p
See Presentation.
7 p; ]! p7 T0 _) k" _8 n& ^+ cRecommended Client Changes (Windows)" p0 _8 V2 N+ H+ p. {
See Presentation.5 }4 ?7 g+ }/ ^" J' u
Performance Monitoring Tools
- h! o' z; r' C% C7 [9 U• Some useful performance monitoring tools:0 B4 h, Y1 Y& F% I# B9 ^, n
• Performance Monitor (comes with Windows)
( ~# o. r/ V2 f6 R7 G( v( v4 {• Used to monitor OS, Teamcenter, and SQL use of resources0 {3 W4 E+ E/ C; x+ R
• Wireshark (freeware network packet sniffer)
+ D1 H# p2 Q: a8 Z• Used to help identify network TCP performance between computers.7 F9 I7 g( O0 f+ e& Z( z
• Available at http://www.wireshark.org/
; ~- X* Y+ G6 h" Y• Sysinternals Suite (free from Microsoft web site)
/ @* Z0 j" Y- H: ?5 G• http://technet.microsoft.com/en-us/sysinternals/bb8420620 M; m5 ^& P+ [! s8 `1 O, K7 R( p
Reference Materials: r S# e2 u8 K+ s6 S1 X% Y
• Available on GTAC Web Site @ http://support.industrysoftware.automation.siemens.com/docs/teamcenter/
! L4 w# [% w" u8 u9 n7 |o Teamcenter Deployment Guide
2 R$ }! Q" x* Uo Teamcenter Network Performance Tuning
7 g0 e' A9 I& B) to JBoss 4.2.2 Installation & Tuning Guide' n' S5 o" \0 x2 A6 G( U/ v* h
o Optimizing Teamcenter Client Performance
$ l+ k# f" g6 g) d# Jo Teamcenter System Performance Analysis
& z; q* B Y: ~- V• Oracle documentation & web sites6 b9 C% ]% Y# W4 o
• MS SQL Server documentation in addition to:4 v- t; N R+ O9 }) L) ?4 u
o Best Practices for Running Siemens Teamcenter on SQL Server2 C n2 k' ^9 U5 g. H6 E
http://download.microsoft.com/download/7/3/6/7365D2BB-BB34-4D28-A128-F2C8FBA6E995/Siemens-Teamcenter-and-SQL-Server-Best-Practices.pdf
, D3 O5 ^. Z. S, [: }) ho Siemens Blog on Technet, K1 t6 `) A- V6 M$ a
http://blogs.technet.com/b/sql_server_isv/archive/tags/siemens/8 V9 c& @$ l4 {, [ k% C
o Siemens-Teamcenter-SQL-Resource-Page
! }: ?0 R* z Q0 e' `. X n, O http://blogs.technet.com/b/sql_server_isv/p/siemens-teamcenter-sql-server-resource-page.aspx& E+ ^8 P+ @, I
• Past PLM World Conference Presentations available at www.plmworld.org,
1 u# Y2 o F* E0 [2 Uo Teamcenter 4-Tier Deployment – Best Practices
7 b) W+ K, A T5 To Teamcenter – Database Performance/ c9 s" m4 P8 }; M! \
o JBoss Optimization for Teamcenter
: l: G' c. _6 L- u* R. [* ko Optimizing Teamcenter Client Performance
1 g3 j5 u g& d8 Eo Teamcenter Database Server Configuration & Tuning U" g' n# b3 h6 t7 J4 D6 W
Contact Information3 {( m, }7 w, O7 N# z( x% W
Larry Carpenter P.E., PLM World Teamcenter SIG Chair, tcua@plmworld.org2 e4 b) J, r% ]% q$ z) R) s
Teamcenter UA SIG: http://www.plmworld.org/TC_UA
6 s R4 ?. g1 C! ULinkedIn: http://www.linkedin.com/pub/larry-carpenter-pe/44/5b8/aaa
/ P5 T8 Y* }! L) bAlternate Contact Info: ideas2nx@plmworld.org, larry.carpenter@siemens.com
; g5 ], Y3 p7 H3 _5 r$ }
6 N% ~6 [. D' c& N7 a: b |
|