1、Linux+nginx+tomcat+JDK 整合实现 JAVA 程序负载均衡本组合使用软件各个版本：Centos 5 Nginx-0.7.60-linux.tar.gz tomcat5.5.27 for linux.zip jdk1_5_0_09-linux.bin pcre-7.8.tar.gz操作系统安装不再详细说明，网上相关文档一大堆。一.软件安装：安装 JDK将 jdk1_5_0_09-linux.bin 文件 cp 到/usr/local 目录下添加权限：chmod u+x jdk1_5_0_09-linux.bin执行安装：./ jdk1_5_0_09-linux.bin 按照提
2、示输入 yes 即可完成安装安装完成后会在/usr/local 下有个名为 jdk1.5.0_09 的目录由于我做负载均衡，所以安装了两个 tomcat，解压 tomcat 到/usr/local/tomcat1 和/usr/local/tomcat2分别进入/usr/local/tomcat1/bin 和/usr/local/tomcat2/bin 目录执行命令：chmod u+x *.Sh 设置权限Tomcat1 保持不变，修改 tomcat2 下 conf 中 server.xml将红色字体的端口更改成其他不使用的端口，例如：8005 更改为 9005，8080 更改为 8081，800
3、9 更改为9009修改 tomcat2 下 bin 中的 startup.sh 和 shutdown.sh 添加以下内容export JAVA_HOME=/usr/local/java1.5.0_09export PATH=$PATH:$JAVA_HOME/binexport CLASSPATH=$JAVA_HOME/libexport CATALINA_HOME=$CATALINA_2_HOMEexport CATALINA_BASE=$CATALINA_2_BASEvi /etc/profile 配置系统变量，打开后添加以下内容：JAVA_HOME=/usr/local/java1.5.0
4、_09export JAVA_HOMECATALINA_BASE=/usr/local/tomcat1CATALINA_HOME=/usr/local/tomcat1export CATALINA_BASE CATALINA_HOMETOMCAT_HOME=/usr/local/tomcat1export TOMCAT_HOMECATALINA_2_BASE=/usr/local/tomcat2CATALINA_2_HOME=/usr/local/tomcat2export CATALINA_2_BASE CATALINA_2_HOMETOMCAT_2_HOME=/usr/local/tomc
5、at2export TOMCAT_2_HOMEJRE_HOME=/usr/local/java1.5.0_09/jreexport JRE_HOMECLASSPATH=/usr/local/java1.5.0_09/lib: /usr/local/java1.5.0_09/jre/libexport CLASSPATHPATH=$PATH:/usr/local/java1.5.0_09/bin:/usr/local/java1.5.0_09/jre/bin:/usr/local/tomcat1/bin:/usr/local/tomcat2/binexport PATH保存退出，logout 注
6、销一下测试 JDK 是否安装成功Java version看是否显示为刚刚安装的 jdk 版本名称分别进入/usr/local/tomcat1/bin 和/usr/local/tomcat2/bin 目录执行./startup.sh访问 http:/local:8080/和 http:/localhost:8081/看是否可以看到 tomcat 的欢迎界面设置 tomcat 随系统启动vi /etc/rc.d/rc.local 添加以下内容/usr/local/tomcat1/bin/startup.sh/usr/local/tomcat2/bin/startup.sh安装 nginx，在安装
7、nginx 之前需要先安装所需的 pcre 库解压我们下载的 pcre-7.8.tar.gztar zxvf pcre-7.8.tar.gzcd pcre-7.8./configuremakemake install安装完毕解压 nginx-0.7.60-linux.tar.gztar zxvf nginx-0.7.60-linux.tar.gz./configure-user=www-group=www-prefix=/usr/local/nginx-with-http_stub_status_module-with-http_ssl_module创建代理文件 vi /usr/local/n
8、ginx/conf/proxy.conf 输入以下内容proxy_redirect off;proxy_set_header Host $host;proxy_set_header X-Real-IP $remote_addr;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;client_max_body_size 10m;client_body_buffer_size 128k;proxy_connect_timeout 600;proxy_read_timeout 600;proxy_send_timeout 600;
9、proxy_buffer_size 8k;proxy_buffers 4 32k;proxy_busy_buffers_size 64k;proxy_temp_file_write_size 64k;保存退出。编辑 nginx.conf 文件 vi /usr/local/nginx/conf/nginx.conf 修改如下#运行用户#user nobody;#启用进程worker_processes 2;#全局错误日志和 piderror_log logs/error.log;#error_log logs/error.log notice;#error_log logs/error.log
10、info;pid logs/nginx.pid;#工作模式及连接数上限worker_rlimit_nofile 51200;events worker_connections 51200;#配置 http 已经反向代理做负载均衡http include mime.types;default_type application/octet-stream;include proxy.conf;#log_format main $remote_addr - $remote_user $time_local “$request“ # $status $body_bytes_sent “$http_ref
11、erer“ # “$http_user_agent“ “$http_x_forwarded_for“;#access_log logs/access.log main;sendfile on;#tcp_nopush on;#keepalive_timeout 0;keepalive_timeout 65;#gzip on;#配置负载均衡服务列表,weight 参数表示权重值，值越大权重越高upstream proxyserver #ip_hash;server localhost:8080 weight=6;server localhost:8081 weight=1;server #端口以及
12、域名配置listen 80;server_name ;#charset koi8-r;#access_log logs/host.access.log main;location /NginxStatus/ stub_status on; access_log off; #设定默认首页location / root /wwwroot/ROOT;index index.html login.jsp;#禁止访问 WEB-INFlocation /(WEB-INF)/ deny all;#设定浏览器访问时 nginx 直接处理和需缓存的文件后缀以及时间参数location .(gif|jpg|jpe
13、g|png|bmp|ico|rar|css|zip|txt|flv|swf|mid|doc|ppt|xls|pdf|txt|mp3|wma)$ root /wwwroot/ROOT;expires 24h;location .(htm|html)$ root /wwwroot/ROOT;#设定此后缀的文件利用反向代理转给负载均衡列表中的 tomcat 处理location .jsp$ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;location .do$ pro
14、xy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;location .js$ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;location .xml$ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;locatio
15、n /dwr/ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;location /html/fckeditor/ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;server listen 80;server_name ;#charset koi8-r;#access_log logs/host.access.log main;loca
16、tion /NginxStatus/ stub_status on;access_log off;location / root /wwwroot/ROOT;index col.html login.jsp;location /(WEB-INF)/ deny all;location .(gif|jpg|jpeg|png|bmp|ico|rar|css|zip|txt|flv|swf|mid|doc|ppt|xls|pdf|txt|mp3|wma)$ root /wwwroot/ROOT;expires 24h;location .(htm|html)$ root /wwwroot/ROOT;
17、location .jsp$ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;location .do$ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;location .js$ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forw
18、arded_for;location .xml$ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;location /dwr/ proxy_pass http:/proxyserver;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;location /html/fckeditor/ proxy_pass http:/proxyserver;proxy_set_header X-Forwarde
19、d-For $proxy_add_x_forwarded_for;Nginx 启动命令：sbin/nginx最后就是设置 tomcat 集群所需的 session 同步分别打开 tomcat1 和 tomcat2 下 conf 中 server.xml找到Tomcat1 下的修改为Tomcat2 下的修改为找到将注释去掉启用此功能，注意两处修改tcpListenAddress=“127.0.0.1“tcpListenPort=“4001“tcpListenAddress 修改为此 tomcat 所在机器的 IP 地址，如果两个 tomcat 在同一台服务器上那么tcpListenPort 的端
20、口需要修改，如果不在同一台服务器上只需要修改 IP 即可。Linux 下默认没有开启组播功能，所以需要开下route add -net 224.0.0.0 netmask 240.0.0.0 dev eth0如果需要在服务器启动时即开通组播需要修改Vi /etc/sysconfig/static-routes添加以下内容eht0 net 224.0.0.0 netmask 240.0.0.0还需要在程序的 web.xml 里面前面加入以下这句话session 同步到这里设置完毕优化 linux 内核vi /etc/sysctl.conf在末尾添加以下内容net.ipv4.tcp_fin_tim
21、eout = 30net.ipv4.tcp_keepalive_time = 300net.ipv4.tcp_syncookies = 1net.ipv4.tcp_tw_reuse = 1net.ipv4.tcp_tw_recycle = 1net.ipv4.ip_local_port_range = 5000 65000使设置立即生效：/sbin/sysctl pulimit a 查看系统资源限制设定ulimit -n 4096 修改 open file 参数值为 4096用 ulimit -n 修改 open files 总是不能保持。所以用下面一个简单的办法更好些。修改/etc/security/limits.conf 添加如下一行：* - nofile 1006154修改/etc/pam.d/login 添加如下一行session required /lib/security/pam_limits.so
