Main Page - Revision history

Ramon: added distiction between windows desktop and webdriver

2023-01-17T09:14:55Z

added distiction between windows desktop and webdriver

← Older revision		Revision as of 09:14, 17 January 2023
Line 165:		Line 165:
	\|September 2029		\|September 2029
	\|}		\|}
	The TESTAR binaries that are downloaded currently supports Windows. ~~We have older versions that work with~~ MacOS, Linux and Android.		The TESTAR binaries that are downloaded currently supports Windows Desktop applications. When using the WebDriver TESTAR can also run on MacOS, Linux, Docker and Android.

	===What is required from the System Under Test (SUT)?===		===What is required from the System Under Test (SUT)?===

Ramon: Added java SE supported versions

2023-01-17T08:21:36Z

Added java SE supported versions

← Older revision		Revision as of 08:21, 17 January 2023
Line 150:		Line 150:
	===Which platforms are supported?===		===Which platforms are supported?===

			Testar needs Java Standard Edition (SE) to run and we support the Java SE LTS versions that are currently under Oracle Extended support [https://www.oracle.com/java/technologies/java-se-support-roadmap.html]. Other versions might work .
			{\| class="wikitable"
			\|+
			!Java SE version
			!Testar Support Until
			\|-
			\|8
			\|December 2030
			\|-
			\|11
			\|September 2026
			\|-
			\|17
			\|September 2029
			\|}
	The TESTAR binaries that are downloaded currently supports Windows. We have older versions that work with MacOS, Linux and Android.		The TESTAR binaries that are downloaded currently supports Windows. We have older versions that work with MacOS, Linux and Android.

Borja at 15:47, 28 May 2021

2021-05-28T15:47:57Z

← Older revision		Revision as of 15:47, 28 May 2021
Line 87:		Line 87:

	<br /><br />		<br /><br />



Line 125:		Line 124:
	*''Sequences'':<p>Number of sequences to be executed.</p>		*''Sequences'':<p>Number of sequences to be executed.</p>
	*''>'':<p>Everything about the command line is stored in the specified temporary file.</p>		*''>'':<p>Everything about the command line is stored in the specified temporary file.</p>


	As we can see in the second example, there is a parameter called ''ExtendedSettingsFile'', An XML file that contains additional settings is referenced by it, and looks like the next image. In this case, its content consists mainly of attributes related to the Reinforcement Learning technique.		As we can see in the second example, there is a parameter called ''ExtendedSettingsFile'', An XML file that contains additional settings is referenced by it, and looks like the next image. In this case, its content consists mainly of attributes related to the Reinforcement Learning technique.
Line 130:		Line 130:


	<br />		<br /><br />

	<br />

	====Workers logs and outputs====		====Workers logs and outputs====

Borja at 15:45, 28 May 2021

2021-05-28T15:45:00Z

← Older revision		Revision as of 15:45, 28 May 2021
Line 86:		Line 86:
	#Clean and copy OrientDB (Image "4_Clean_And_Copy_OrientDB.bat"):[[File:2.4 CCOrientDB.jpg\|thumb\|595x595px\|4_Clean_And_Copy_OrientDB.bat]]<p>If there is any version of OrientDB in the desktop, it will be removed. After that, the version of Orientdb that is stored in the "''N:\demo_files''" folder will be copied to the desktop.</p>		#Clean and copy OrientDB (Image "4_Clean_And_Copy_OrientDB.bat"):[[File:2.4 CCOrientDB.jpg\|thumb\|595x595px\|4_Clean_And_Copy_OrientDB.bat]]<p>If there is any version of OrientDB in the desktop, it will be removed. After that, the version of Orientdb that is stored in the "''N:\demo_files''" folder will be copied to the desktop.</p>

	<br />		<br /><br />

Borja at 15:44, 28 May 2021

2021-05-28T15:44:35Z

← Older revision		Revision as of 15:44, 28 May 2021
Line 87:		Line 87:

	<br />		<br />

Borja at 15:43, 28 May 2021

2021-05-28T15:43:59Z

← Older revision		Revision as of 15:43, 28 May 2021
Line 87:		Line 87:

	<br />		<br />


	====How to launch multiple batch and workers====		====How to launch multiple batch and workers====
Line 127:		Line 128:



			<br />

	<br />		<br />

Borja at 15:43, 28 May 2021

2021-05-28T15:43:11Z

← Older revision		Revision as of 15:43, 28 May 2021
Line 117:		Line 117:
	''TEST_SpaghettiRandom.bat'', mentioned above, is an example of a specific batch file for the Spaghetti SUT and the Random ASM. In the image on the left you can be seen the content of two files corresponding to the Spaghetti SUT, one of them with the Random ASM, and the other with the Reinforcement Learning ASM. The main parameters that these type of files contain are:		''TEST_SpaghettiRandom.bat'', mentioned above, is an example of a specific batch file for the Spaghetti SUT and the Random ASM. In the image on the left you can be seen the content of two files corresponding to the Spaghetti SUT, one of them with the Random ASM, and the other with the Reinforcement Learning ASM. The main parameters that these type of files contain are:

	* ''sse'':<p>The application to be run</p>		*''sse'':<p>The application to be run</p>
	* ''ShowVisualSettingsDialogOnStartup'':<p>It is set to False to not run the GUI of TESTAR.</p>		*''ShowVisualSettingsDialogOnStartup'':<p>It is set to False to not run the GUI of TESTAR.</p>
	* ''ApplicationName'':<p>TESTAR uses this name to save the output files and the metrics in the folder associated with each worker.</p>		*''ApplicationName'':<p>TESTAR uses this name to save the output files and the metrics in the folder associated with each worker.</p>
	* ''ApplicationVersion'':<p>It is not very important, as there is a new version of the SUT in each execution.</p>		*''ApplicationVersion'':<p>It is not very important, as there is a new version of the SUT in each execution.</p>
	* ''Sequences'':<p>Number of sequences to be executed.</p>		*''Sequences'':<p>Number of sequences to be executed.</p>
	* ''>'':<p>Everything about the command line is stored in the specified temporary file.</p>		*''>'':<p>Everything about the command line is stored in the specified temporary file.</p>

	As we can see in the second example, there is a parameter called ''ExtendedSettingsFile'', An XML file that contains additional settings is referenced by it, and looks like the next image. In this case, its content consists mainly of attributes related to the Reinforcement Learning technique.		As we can see in the second example, there is a parameter called ''ExtendedSettingsFile'', An XML file that contains additional settings is referenced by it, and looks like the next image. In this case, its content consists mainly of attributes related to the Reinforcement Learning technique.



			<br />

	====Workers logs and outputs====		====Workers logs and outputs====

Borja at 15:42, 28 May 2021

2021-05-28T15:42:25Z

← Older revision		Revision as of 15:42, 28 May 2021
Line 117:		Line 117:
	''TEST_SpaghettiRandom.bat'', mentioned above, is an example of a specific batch file for the Spaghetti SUT and the Random ASM. In the image on the left you can be seen the content of two files corresponding to the Spaghetti SUT, one of them with the Random ASM, and the other with the Reinforcement Learning ASM. The main parameters that these type of files contain are:		''TEST_SpaghettiRandom.bat'', mentioned above, is an example of a specific batch file for the Spaghetti SUT and the Random ASM. In the image on the left you can be seen the content of two files corresponding to the Spaghetti SUT, one of them with the Random ASM, and the other with the Reinforcement Learning ASM. The main parameters that these type of files contain are:

	* ''sse'': The application to be run		* ''sse'':<p>The application to be run</p>
	* ''ShowVisualSettingsDialogOnStartup'': It is set to False to not run the GUI of TESTAR.		* ''ShowVisualSettingsDialogOnStartup'':<p>It is set to False to not run the GUI of TESTAR.</p>
	* ''ApplicationName'': TESTAR uses this name to save the output files and the metrics in the folder associated with each worker.		* ''ApplicationName'':<p>TESTAR uses this name to save the output files and the metrics in the folder associated with each worker.</p>
	* ''ApplicationVersion'': It is not very important, as there is a new version of the SUT in each execution.		* ''ApplicationVersion'':<p>It is not very important, as there is a new version of the SUT in each execution.</p>
	* ''Sequences'': Number of sequences to be executed.		* ''Sequences'':<p>Number of sequences to be executed.</p>
	* ''>'': Everything about the command line is stored in the specified temporary file.		* ''>'':<p>Everything about the command line is stored in the specified temporary file.</p>

	As we can see in the second example, there is a parameter called ''ExtendedSettingsFile'', An XML file that contains additional settings is referenced by it, and looks like the next image. In this case, its content consists mainly of attributes related to the Reinforcement Learning technique.		As we can see in the second example, there is a parameter called ''ExtendedSettingsFile'', An XML file that contains additional settings is referenced by it, and looks like the next image. In this case, its content consists mainly of attributes related to the Reinforcement Learning technique.

Borja at 15:40, 28 May 2021

2021-05-28T15:40:27Z

← Older revision		Revision as of 15:40, 28 May 2021
Line 109:		Line 109:

	<code>for i in 10.10* ; do echo $i; cp -v batch_demo/TEST_SpaghettiRandom.bat $i/queue/e_TEST_SpaghettiRandom.bat; done</code>		<code>for i in 10.10* ; do echo $i; cp -v batch_demo/TEST_SpaghettiRandom.bat $i/queue/e_TEST_SpaghettiRandom.bat; done</code>
			[[File:Spaghetti Random and RL batch files.jpg\|thumb\|718x718px\|Spaghetti Random and RL batch files]]


	As there are multiple batch files to execute, we use alphabetical order by placing a letter at the beginning of the name of the new files.		As there are multiple batch files to execute, we use alphabetical order by placing a letter at the beginning of the name of the new files.
	~~<br /~~>
			[[File:WidDiff-ExtFile.jpg\|thumb\|494x494px\|Widget difference extended settings file]]
			''TEST_SpaghettiRandom.bat'', mentioned above, is an example of a specific batch file for the Spaghetti SUT and the Random ASM. In the image on the left you can be seen the content of two files corresponding to the Spaghetti SUT, one of them with the Random ASM, and the other with the Reinforcement Learning ASM. The main parameters that these type of files contain are:

			* ''sse'': The application to be run
			* ''ShowVisualSettingsDialogOnStartup'': It is set to False to not run the GUI of TESTAR.
			* ''ApplicationName'': TESTAR uses this name to save the output files and the metrics in the folder associated with each worker.
			* ''ApplicationVersion'': It is not very important, as there is a new version of the SUT in each execution.
			* ''Sequences'': Number of sequences to be executed.
			* ''>'': Everything about the command line is stored in the specified temporary file.

			As we can see in the second example, there is a parameter called ''ExtendedSettingsFile'', An XML file that contains additional settings is referenced by it, and looks like the next image. In this case, its content consists mainly of attributes related to the Reinforcement Learning technique.

	====Workers logs and outputs====		====Workers logs and outputs====

Borja at 11:33, 19 May 2021

2021-05-19T11:33:08Z

← Older revision		Revision as of 11:33, 19 May 2021
Line 54:		Line 54:
	[[File:2.4 folders-.jpg\|thumb\|548x548px\|alt=\|border\|Structure of the N directory]]		[[File:2.4 folders-.jpg\|thumb\|548x548px\|alt=\|border\|Structure of the N directory]]

			<br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />

















	<br />
	====Preparation of a centralized TESTAR distribution====		====Preparation of a centralized TESTAR distribution====
	A single, stable TESTAR distribution must be used for all workers. This avoids unexpected behavior differences that might appear when using different versions.		A single, stable TESTAR distribution must be used for all workers. This avoids unexpected behavior differences that might appear when using different versions.
Line 99:		Line 81:
	For Each SUT + Protocol we will need a customized batch file to launch TESTAR with the desired settings. Between every execution, to have the same initial state, each worker will:		For Each SUT + Protocol we will need a customized batch file to launch TESTAR with the desired settings. Between every execution, to have the same initial state, each worker will:

	#Restart the system (Image "1_Restart_System.bat"):[[File:2.4 Restart System.jpg\|thumb\|273x273px\|1_Restart_System.bat]]Each worker needs a new and stable version of the system to run the experiments reliably. For this, they go to the desktop and execute an instruction to shutdown the system and start it again.		#Restart the system (Image "1_Restart_System.bat"):[[File:2.4 Restart System.jpg\|thumb\|273x273px\|1_Restart_System.bat]]<p>Each worker needs a new and stable version of the system to run the experiments reliably. For this, they go to the desktop and execute an instruction to shutdown the system and start it again.</p>
	#Set a specific resolution (Image "2_Prepare_Screen_Resolution.bat"):[[File:2.4 Resolution.jpg\|thumb\|341x341px\|2_Prepare_Screen_Resolution.bat]]We need to always have the same resolution in the system, so we execute the ''VMwareResolution.exe'' file with the appropriate parameters. This file is stored in the "''C:\Program Files\VMware\VMware Tools''" folder.		#Set a specific resolution (Image "2_Prepare_Screen_Resolution.bat"):[[File:2.4 Resolution.jpg\|thumb\|341x341px\|2_Prepare_Screen_Resolution.bat]]<p>We need to always have the same resolution in the system, so we execute the ''VMwareResolution.exe'' file with the appropriate parameters. This file is stored in the "''C:\Program Files\VMware\VMware Tools''" folder.</p>
	#Clean and copy TESTAR (Image "3_Clean_And_Copy_TESTAR.bat"):[[File:2.4 CCTestar.jpg\|thumb\|445x445px\|3_Clean_And_Copy_TESTAR.bat]]The workers go to the desktop and remove any TESTAR distribution. Then, they copy the TESTAR distribution located in the "''N:\demo_files''" folder to the desktop.		#Clean and copy TESTAR (Image "3_Clean_And_Copy_TESTAR.bat"):[[File:2.4 CCTestar.jpg\|thumb\|445x445px\|3_Clean_And_Copy_TESTAR.bat]]<p>The workers go to the desktop and remove any TESTAR distribution. Then, they copy the TESTAR distribution located in the "''N:\demo_files''" folder to the desktop.</p>
	#Clean and copy OrientDB (Image "4_Clean_And_Copy_OrientDB.bat"):[[File:2.4 CCOrientDB.jpg\|thumb\|595x595px\|4_Clean_And_Copy_OrientDB.bat]]If there is any version of OrientDB in the desktop, it will be removed. After that, the version of Orientdb that is stored in the "''N:\demo_files''" folder will be copied to the desktop		#Clean and copy OrientDB (Image "4_Clean_And_Copy_OrientDB.bat"):[[File:2.4 CCOrientDB.jpg\|thumb\|595x595px\|4_Clean_And_Copy_OrientDB.bat]]<p>If there is any version of OrientDB in the desktop, it will be removed. After that, the version of Orientdb that is stored in the "''N:\demo_files''" folder will be copied to the desktop.</p>

	<br />		<br />