Skip to content
Snippets Groups Projects
Select Git revision
  • 1b6f3418bcf530fd9f871087daa28269e5cd65b3
  • master default protected
  • artifact-evaluation
  • artifact-evaluation-poster
  • ci
5 results

trainbenchmark

Forked from stgroup / trainbenchmark
103 commits behind the upstream repository.
Name Last commit Last update
diagrams
docs
gradle
logs
models
results
scripts
trainbenchmark-config
trainbenchmark-format-emf-model
trainbenchmark-format-emf
trainbenchmark-format-graph-neo4j
trainbenchmark-format-rdf
trainbenchmark-format-sql
trainbenchmark-generator-dot
trainbenchmark-generator-emf
trainbenchmark-generator-graph-cypher
trainbenchmark-generator-graph-neo4j
trainbenchmark-generator-graph-tinkerpop
trainbenchmark-generator-json4ag-special
trainbenchmark-generator-json4ag
trainbenchmark-generator-rdf
trainbenchmark-generator-sql
trainbenchmark-generator
trainbenchmark-reporting
trainbenchmark-scripts
trainbenchmark-server
trainbenchmark-tool-blazegraph
trainbenchmark-tool-drools
trainbenchmark-tool-eclipseocl
trainbenchmark-tool-emf
trainbenchmark-tool-emfapi
trainbenchmark-tool-epsilon
trainbenchmark-tool-ingraph-query-plans
trainbenchmark-tool-ingraph
trainbenchmark-tool-jastadd-base
trainbenchmark-tool-jastadd-namelookup-base
trainbenchmark-tool-jastadd-namelookup-incremental
trainbenchmark-tool-jastadd-namelookup
trainbenchmark-tool-jastadd-optimized-base
trainbenchmark-tool-jastadd-optimized-incremental
trainbenchmark-tool-jastadd-optimized
trainbenchmark-tool-jastadd-specialized-base
trainbenchmark-tool-jastadd-specialized-incremental
trainbenchmark-tool-jastadd-specialized
trainbenchmark-tool-jena
trainbenchmark-tool-kiama
trainbenchmark-tool-mysql
trainbenchmark-tool-neo4j
trainbenchmark-tool-racr-cpp
trainbenchmark-tool-racr-python
trainbenchmark-tool-racr-scheme
trainbenchmark-tool-racr
trainbenchmark-tool-rdf
trainbenchmark-tool-rdf4j
trainbenchmark-tool-sesame
trainbenchmark-tool-sql
trainbenchmark-tool-sqlite
trainbenchmark-tool-tinkergraph
trainbenchmark-tool-viatra-patterns
trainbenchmark-tool-viatra
trainbenchmark-tool
visualization
pracr-python @ f15c5bb0
pracr-scheme @ f15c5bb0
racr-cpp @ 2f4ee264
.editorconfig
.gitignore
.gitmodules
.travis.yml
LICENSE
README.md
build.gradle
gradlew
gradlew.bat
runBenchmark.launch
runGenerator.launch
settings.gradle

Train Benchmark

Build Status

🚂 Summary. The Train Benchmark is a framework for measuring the performance of continuous model transformations, with a particular emphasis on the performance of incremental query reevaluation. The benchmark is actively developed since 2011.

💻 Technologies. The framework is implemented in Java 8 (for the main components) and Groovy (for the scripts). The visualization is handled by R scripts. Both the build and the benchmark process in governed by Gradle.

👋 Contributions welcome. If you would like to implement the benchmark on your tool, we recommend to read the documentation and also please do not hesitate to get in contact!

⚠️ Warning. The Train Benchmark is designed to run in an isolated server environment, e.g. virtual machines in the cloud. Some implementations may shut down or delete existing databases, so only run it on your developer workstation if you understand the consequences. See also issue #75.

📔 Note. The Train Benchmark has a fork for the 2015 Transformation Tool Contest, primarily targeting EMF tools. That fork is no longer maintained. You should use this repository, containing the full, cross-technology Train Benchmark (also supporting RDF, SQL and property graph databases).

📖 Details. If you are interested in getting the benchmark working or contributing, visit the documentation.

📚 Publications. the definitive publication on the benchmark is our journal paper The Train Benchmark: cross-technology performance evaluation of continuous model queries. For use cases, also check out the related publications.

Citing the benchmark. For citing the benchmark, use the following BibTeX snippet.

@article{TrainBenchmark2017,
  author="Sz{\'a}rnyas, G{\'a}bor and Izs{\'o}, Benedek and R{\'a}th, Istv{\'a}n and Varr{\'o}, D{\'a}niel",
  title="The Train Benchmark: cross-technology performance evaluation of continuous model queries",
  journal="Software {\&} Systems Modeling",
  year="2017",
  pages="1--29",
  issn="1619-1374",
  doi="10.1007/s10270-016-0571-8",
  url="http://dx.doi.org/10.1007/s10270-016-0571-8"
}

License

The project uses the Eclipse Public License 1.0 and was supported by the MONDO EU FP7 (EU ICT-611125) project. It is currently developed by the MTA-BME Lendület Research Group on Cyber-Physical Systems.