Thursday, December 6, 2007

How to upload different files for each user thread in JMeter

The way to have each individual JMeter thread (user) upload a different file to a remote web server is to add entries to the "User Parameters" module.

1) In your thread-group, Add Pre Processors > User Parameters to Thread Group
2) To add variables specific to each user, see: http://jakarta.apache.org/jmeter/usermanual/component_reference.html#User_Parameters

JMeter Load Testing on IU HPSS/MDSS

Here is the scenerio I'm proposing:

Test files:
+ 1-10MB
+ 50-200MB
+ 1GB+

Steps in load testing:
1) Log into OGCE
2) Get MyProxy credentials
3) Open file-manager portlet
4) Open connection to BigRed on left
5) Open connection to MDSS on right
6) Upload test file to MDSS
7) Transfer test file from MDSS to BigRed
8) Delete test file from MDSS
9) Transfer test file from BigRed to MDSS
7) Download test file
8) Repeat step 6 with other test files

Friday, November 16, 2007

Random build failures with maven

Some builds are seemingly failing at random, the cause is the fact that maven is downloading corrupted jar files during build time. A possible cause for this is network timeout.

What I am planning to do to correct for this is to try rebuilding the portal up to 3 times if the build fails. Below is script code for how to detect build failures and rebuild if necessary.
The key line is: "if test $? -ne 0; then"
This detects a maven build failure.


maven-2.0.7/bin/mvn -e clean install

if test $? -ne 0; then
echo ----------- MAVEN BUILD FAILED, TRYING AGAIN.. ATTEPMT 1 -----------
maven-2.0.7/bin/mvn -e clean install
fi

if test $? -ne 0; then
echo ----------- MAVEN BUILD FAILED, TRYING AGAIN.. ATTEPMT 2 -----------
maven-2.0.7/bin/mvn -e clean install
fi


if test $? -ne 0; then
echo ----------- MAVEN BUILD FAILED, TRYING AGAIN.. ATTEPMT 3 -----------
maven-2.0.7/bin/mvn -e clean install
fi


if test $? -ne 0; then
echo ----------- MAVEN BUILD FAILED, EXITING -----------
exit 0
fi

Thursday, November 1, 2007

Crontab

To get an NMI build running nightly, use a crontab as such:

1) Type:
> crontab -e
2) Enter the following into the crontab file:

MAILTO=youremail@domain.com
20 12 1 11 4 (. /nmi/bin/config.sh && nmi_submit <$HOME/yoursubmitfile.submit>)


The above crontab entry runs "nmi_submit <$HOME/yoursubmitfile.submit>" at 12:20noon, 1st day of the month, november (11), at 4th day of the week (thursday).
Consult this webpage for more details about cron: http://www.adminschoice.com/docs/crontab.htm

Tuesday, October 30, 2007

Build process steps for NMI

These are the important steps for establishing nightly builds on NMI
1) Set your project name: OGCE
2) Make sure $JAVA_HOME is set correctly - currently I am setting it manually in my build scripts
3) Put email addresses in NMI submit file so that relevant people are informed
4) Add cron tabs for scripts

Friday, October 26, 2007

Problem compiling portal through NMI testbed on Linux distros

For some reason, the portal will not compile on any of the NMI testbed linux distros; however, it will compile for macos_10.4

These are the types of compile time errors I was getting:

[WARNING] repository metadata for: 'artifact org.apache.maven.plugins:maven-clean-plugin' could not be retrieved from repository: central due to an error: Specified destination directory cannot be created: /home/vm1-user/.m2/repository/org/apache/maven/plugins/maven-clean-plugin
[INFO] Repository 'central' will be blacklisted
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD ERROR
[INFO] ------------------------------------------------------------------------



[INFO] Error executing ant tasks

Embedded error: Directory /home/vm1-user/.globus/GridPortRepository creation was not successful for an unknown reason




The reason for the above errors is that both the .m2 directory and the .globus directory are using the incorrect $HOME value. I fixed the .m2 repository directory path by modifying maven/conf/settings.xml

${env.HOME}/.m2/repository


The incorrect globus directory is all over the place, need to fix it still

Friday, October 5, 2007

NMI Build & Test issues

I'm trying to build the OGCE portal on NMI framework, but I'm getting some problems.


The script I'm using is further down, but anyways whenever it tries to build using the script, I get the following error from maven:
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD ERROR
[INFO] ------------------------------------------------------------------------
[INFO] Error executing ant tasks

Embedded error: The following error occurred while executing this line:
/Users/condor/execute/dir_26580/userdir/ogce-portal-only/containers/gridsphere/gridsphere-2.1.5/config/build/build-compile.xml:22: /Users/condor/execute/dir_26580/ogce-portal-only/portal_deploy/apache-tomcat-5.5.12/common/lib not found.



----------------------------------------------
The script I made:

echo
echo --------- Which java are we running? ---------
which java
java -version

echo
echo --------- What about javac? ---------
which javac
javac -version


## Untar apache tomcat server and move it to portal dir ##
cd ogce-portal-only/portal_deploy
tar xzf apache-tomcat-5.5.12.tar.gz

## extract maven and move it to portal dir ##
cd ..
tar xzf maven*.tar.gz

## do the ogce portal maven build ##
maven-2.0.7/bin/mvn install