OmniSciDB: benchmarks.TPC_DS_10GB Class Reference

All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Groups Pages

Inheritance diagram for benchmarks.TPC_DS_10GB:

Collaboration diagram for benchmarks.TPC_DS_10GB:

Public Member Functions
def	checkForRequiredFiles

def	setupAndChdirToWorkingDirectory

def	run

Static Public Attributes
string	SCALE = '10'

	external = True

string	description = 'TPC-DS SCALE=%s SQL tests'

	name = __qualname__

string	BASENAME = 'TPC-DS_Tools_v3.2.0'

string	OUTPUT_DIR = '%s_%sGB'

string	PG_TGZ = OUTPUT_DIR+'.tgz'

string	DATADIR = 'storage'

int	PORT_MAIN = 16274

int	PORT_HTTP = 16278

int	PORT_CALCITE = 16279

float	SENTINEL_FAILED_TIME = 1234567.890

Detailed Description

TPC-DS SQL tests

Definition at line 125 of file benchmarks.py.

Member Function Documentation

def benchmarks.TPC_DS_10GB.checkForRequiredFiles ( self )

Definition at line 142 of file benchmarks.py.

References benchmarks.TPC_DS_10GB.PG_TGZ.

Referenced by benchmarks.TPC_DS_10GB.setupAndChdirToWorkingDirectory().

 
     def checkForRequiredFiles(self):
         assets_dir = os.environ.get('TPCDS_ASSETS_DIR')
         assert assets_dir != None, 'Please set env variable TPCDS_ASSETS_DIR to directory with %s.' % (self.PG_TGZ)
         file = self.PG_TGZ
         assert os.path.exists('%s/.conbench' % os.environ.get('HOME')
           ), 'A .conbench file is required to submit results to a conbench server.'
         assert os.path.exists('%s/%s' % (assets_dir, file)), 'File %s not found in %s.' % (file, assets_dir)
         return assets_dir

benchmarks.TPC_DS_10GB.checkForRequiredFiles

def checkForRequiredFiles

Definition: benchmarks.py:142

benchmarks.TPC_DS_10GB.PG_TGZ

string PG_TGZ

Definition: benchmarks.py:135

Here is the caller graph for this function:

def benchmarks.TPC_DS_10GB.run	(	self,
		kwargs
	)

Definition at line 160 of file benchmarks.py.

References benchmarks.TPC_DS_10GB.DATADIR, benchmarks.StringDictionaryBenchmark.name, benchmarks.TPC_DS_10GB.name, heavyai.open(), benchmarks.TPC_DS_10GB.OUTPUT_DIR, benchmarks.TPC_DS_10GB.PORT_CALCITE, benchmarks.TPC_DS_10GB.PORT_HTTP, benchmarks.TPC_DS_10GB.PORT_MAIN, benchmarks.TPC_DS_10GB.SCALE, benchmarks.TPC_DS_10GB.SENTINEL_FAILED_TIME, benchmarks.TPC_DS_10GB.setupAndChdirToWorkingDirectory(), and benchmarks.testConnection().

 
     def run(self, **kwargs):
         commit = os.environ.get('GIT_COMMIT')
         build_dir = os.path.realpath(os.path.join(os.getcwd(),'../../build-%s'%(commit)))
         self.setupAndChdirToWorkingDirectory(build_dir + '/conbench')
         # Start server on new port
         bindir = build_dir + '/bin'
         heavy_db_server = HeavyDbServer(bindir, self.DATADIR, self.PORT_MAIN, self.PORT_HTTP, self.PORT_CALCITE)
         testConnection(bindir, self.PORT_MAIN)
         # Run rake task
         env = { 'HEAVYSQL': '%s/heavysql -p HyperInteractive --port %d'%(bindir,self.PORT_MAIN)
               , 'SCALE': self.SCALE, 'SKIP_PG': '1', 'PATH': os.environ.get('PATH') }
         subprocess.run('rake tpcds:compare', env=env, shell=True)
         # report to conbench server
         context = { 'benchmark_language': 'C++' }
         info = { 'branch': os.environ.get('GIT_BRANCH') }
         options = kwargs
         # Read and process output json files
         def query_num(filename):
             md = re.search('/query(\d+).json$', filename)
             return int(md.group(1)) if md else 0
         for filename in sorted(glob.glob(self.OUTPUT_DIR+'/query*.json'), key=query_num):
             with open(filename) as file:
                 benchmark = json.load(file)
                 tags = { 'benchmark_name': '%02d' % query_num(filename) }
                 data = [ benchmark['time_ms'] ] if benchmark['success'] else [ self.SENTINEL_FAILED_TIME ]
                 result = { 'data': data, 'unit': 'ms' }
                 info['message'] = benchmark['message'][:4096] # truncate large messages
                 yield self.conbench.record(
                     result, self.name, context=context, options=options, output=result, tags=tags, info=info
                 )

Here is the call graph for this function:

def benchmarks.TPC_DS_10GB.setupAndChdirToWorkingDirectory	(	self,
		workingdir
	)

Definition at line 151 of file benchmarks.py.

References benchmarks.TPC_DS_10GB.checkForRequiredFiles(), and benchmarks.TPC_DS_10GB.PG_TGZ.

Referenced by benchmarks.TPC_DS_10GB.run().

 
     def setupAndChdirToWorkingDirectory(self, workingdir):
         assets_dir = self.checkForRequiredFiles()
         os.mkdir(workingdir, mode=0o775)
         rakefile = os.path.realpath(os.path.join(os.getcwd(),'../rake/Rakefile'))
         subprocess.run(['ln', '-s', rakefile, workingdir])
         os.chdir(workingdir)
         # Untar postgres results
         subprocess.run(['tar', 'zxf', '%s/%s'%(assets_dir,self.PG_TGZ)])

benchmarks.TPC_DS_10GB.checkForRequiredFiles

def checkForRequiredFiles

Definition: benchmarks.py:142

benchmarks.TPC_DS_10GB.PG_TGZ

string PG_TGZ

Definition: benchmarks.py:135

benchmarks.TPC_DS_10GB.setupAndChdirToWorkingDirectory

def setupAndChdirToWorkingDirectory

Definition: benchmarks.py:151

Here is the call graph for this function:

Here is the caller graph for this function:

Public Member Functions

Static Public Attributes

Detailed Description

Member Function Documentation

Member Data Documentation