ORE 2014 will be collocated with the Vienna Summer of Logic 2014 (VSL). The workshop will take place on the 13th July 2014 in Vienna, Austria. More information about the workshop and the reasoner competition can be found here.
We’re very pleased to announce that we have published the CEUR proceedings of the ORE 2013 workshop, including a short report written by us outlining the most important competition results.
In addition, we’ve also release the spreadsheets containing the detailed results, as well as the ontologies we’ve used for the competition (offline and live competition). We also have more detailed results (i.e. outputs and error messages) for each reasoner, but it’s a large amount of messy data, so we’ll only make them available on request for each individual reasoner — if needed.
Thanks again to everyone who participated in this year’s workshop and competition. We’ve been taking notes with all the feedback we’ve received from you, and we’re really looking forward to next year’s workshop, which we’re hoping to organise as part of the Vienna Summer of Logic. If you’re interested in joining next year’s workshop programme committee or become a competition organiser, please contact us by email (firstname.lastname@example.org).
We’ll keep updating this website with information about next year’s workshop until we’ve set up a new page for ORE 2014.
See you next year!
First of all: we hope you all enjoyed ORE this week, along with the live competition and the prize giving at the DL social dinner last night! We think the workshop was a great success, and we’re absolutely pleased that so many people participated and expressed their interest in the OWL reasoner competition. We will be publishing all datasets, raw results and photos in the next few days.
For now, you can find online
Well done to all winners!
A tentative programme for ORE is already available. The workshop has been organised in 4 sessions and each paper has been given a 15 minutes slot (12 min presentation + 3 min questions). Note that, on Wednesday at DL workshop, there will also be a session devoted to ORE where we will run a “live” reasoner competition. Furthermore, the ORE Award Ceremony will take place during the DL social dinner.
We also plan to organise a social dinner after the workshop (not included within the registration fee). Please indicate if you are planning to attend the dinner in this poll, so that we have an approximate number of diners.
We had some great submissions to ORE 2013 covering a broad range of OWL reasoning related topics – reasoner system descriptions, challenging ontologies, performance evaluations, OWL reasoners on mobile devices (!), and reasoner tips&tricks. We’re very pleased to announce that we accepted nearly 20 papers to be presented at this year’s workshop. The final list of papers will be announced on this site soon.
The camera-ready versions of the papers are due on the 27th June. We kindly invite all authors and interested researchers to participate in the OWL Reasoner Evaluation workshop in Ulm on the 22nd July 2013. More information about registration for the workshop can be found here. And finally, please consider submitting your reasoner or ontology for use in the OWL reasoner competition, even if you didn’t submit a paper. Deadline for system submissions is the 27th June, more information about competition submissions can be found on the Competition page.
We would like to thank the authors for their work and their interesting submissions, and the programme committee for their effort in reviewing the papers in a very short time span. See you in Ulm!
Registration for the Description Logic workshop is now open, and the same registration system is used to register for the OWL Reasoner Evaluation workshop. To register for ORE (or both DL and ORE):
The registration fees for the ORE workshop day on the 22nd July are as follows:
We’re looking forward to seeing you in Ulm!
We have had some requests for deadline extensions, so the deadline for paper submissions has been extended to Sunday the 12th May.
We invite submission of short papers (6 pages) describing:
For more information, please see the full Call for Papers.
We’ve released a test-ready version of the benchmarking framework we’re planning to use for the reasoner evaluation competition. Reasoner developers may download the scripts, jars and examples from our repository.
In order to use the benchmarking framework, participates need to create a simple reasoner wrapper and edit the execReasoner shell script in the framework to execute various reasoner tasks. More information can be found along with the code on https://bitbucket.org/spbail/ore-benchmark. If you have any questions or suggestions, please contact the organisers.
Please note that the internals of the benchmarking framework may change. The purpose of the current release is mainly to test the interface and ensure that the reasoners can be executed from the framework.
If you are planning to participate in the competition, we strongly encourage you to submit a system description of your system. Please submit via Easychair by 3rd May 2013 (extension is possible if requested). Details about paper submissions can be found on the Call for papers page.
The submission deadline for the reasoner competition is the 27th June 2013. Details can be found on the Competition page.
Call for Systems (Challenge)
We invite reasoner developers to submit their reasoners for participation in the OWL reasoner performance competition. The outline for the competition is as follows:
The test sets will include OWL ontologies from all OWL 2 profiles and of varying sizes, randomly sampled from the NCBO BioPortal, a web crawl, and user-submitted hard ontologies. The tested tasks will include consistency checking, classification, entailment checking, and query answering. Developers should send a JAR file of their systems to the competition organizers who will then carry out the benchmarks.
More information about the competition can be found on the competition page.
We also strongly encourage challenge participants to submit a system description paper, describing
of their system.
Details of the competition and the submission procedure can be found on the ORE 2013 website: http://ore2013.cs.manchester.ac.uk/competition/
In parallel with the OWL Reasoner Competition, we invite submission of papers describing:
Submissions and review process
Papers should be formatted according to the Springer LNCS guidelines (http://www.springer.de/comp/lncs/authors.html) and should not be longer than 6 pages.
Submissions must be in PDF through the EasyChair conference system: https://www.easychair.org/conferences/?conf=ore2013.
All submissions will be peer-reviewed by the program committee. Selected papers will be presented during the workshop and published as a volume of CEUR workshop proceedings (http://ceur-ws.org/).
For enquiries, please contact the organisers at email@example.com
ORE 2013 will be collocated with the 26th International Workshop on Description Logics (DL). The workshop will take place on the 22nd July 2012 in Ulm, Germany. More information about the workshop and the reasoner competition will be announced here soon.