com.mapd.tests.CtasItasSelectUpdelConcurrencyTest Class Reference

Collaboration diagram for com.mapd.tests.CtasItasSelectUpdelConcurrencyTest:

Public Member Functions
void	testConcurrency () throws Exception

Static Public Member Functions
static void	main (String[] args) throws Exception

Static Package Attributes
static final Logger	logger
static final String[]	text_values

Private Member Functions
void	runTest (String db, String dbaUser, String dbaPassword, String dbUser, String dbPassword) throws Exception

Detailed Description

Definition at line 27 of file CtasItasSelectUpdelConcurrencyTest.java.

Member Function Documentation

static void com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.main ( String[]  args ) throws Exception

inlinestatic

Definition at line 52 of file CtasItasSelectUpdelConcurrencyTest.java.

                                                          {
    CtasItasSelectUpdelConcurrencyTest test = new CtasItasSelectUpdelConcurrencyTest();
    test.testConcurrency();
  }

void com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.runTest ( String  db, String  dbaUser, String  dbaPassword, String  dbUser, String  dbPassword  ) throws Exception

inlineprivate

Definition at line 57 of file CtasItasSelectUpdelConcurrencyTest.java.

References run, and com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.text_values.

Referenced by com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.testConcurrency().

                           {
    int num_threads = 5;
    final int runs = 25;
    final int num_rows = 1000;
    final int fragment_size = 10;
    final String tableName = "test";
    Exception exceptions[] = new Exception[num_threads];

    final CyclicBarrier barrier = new CyclicBarrier(num_threads, new Runnable() {
      public void run() {
        try {
          HeavyDBTestClient dba = HeavyDBTestClient.getClient(
                  "localhost", 6274, db, dbaUser, dbaPassword);
          dba.runSql("CREATE TABLE " + tableName
                  + "(x BIGINT, y INTEGER, z SMALLINT, a TINYINT, f FLOAT, d DOUBLE, deci DECIMAL(18,6), str TEXT ENCODING NONE) WITH (FRAGMENT_SIZE = "
                  + fragment_size + ")");

          for (int i = 0; i < num_rows; i++) {
            final String integer_val = Integer.toString(i);
            final String small_val = Integer.toString(i % 128);
            final String fp_val = Double.toString(i * 1.1);
            final String deci_val = Double.toString(i + 0.01);
            final String str_val = "'" + text_values[i % text_values.length] + "'";
            final String values_string = String.join(" , ",
                    integer_val,
                    integer_val,
                    small_val,
                    small_val,
                    fp_val,
                    fp_val,
                    deci_val,
                    str_val);
            dba.runSql("INSERT INTO " + tableName + " VALUES "
                    + "(" + values_string + ")");
          }

        } catch (Exception e) {
          logger.error("[" + Thread.currentThread().getId() + "]"
                          + " Caught Exception: " + e.getMessage(),
                  e);
          exceptions[0] = e;
        }
      }
    });

    ArrayList<Thread> threads = new ArrayList<>();
    for (int i = 0; i < num_threads; i++) {
      logger.info("Starting " + i);
      final int threadId = i;

      Thread t = new Thread(new Runnable() {
        @Override
        public void run() {
          long tid = Thread.currentThread().getId();
          String logPrefix = "[" + tid + "]";
          String sql = "";

          final String ctasTableName = "ctas_test";

          try {
            barrier.await();

            HeavyDBTestClient user = HeavyDBTestClient.getClient(
                    "localhost", 6274, db, dbUser, dbPassword);

            Random rand = new Random(tid);

            if (threadId == 2) {
              sql = "CREATE TABLE " + ctasTableName + " AS (SELECT x, y, deci, str FROM "
                      + tableName + ");";
              logger.info(logPrefix + " " + sql);
              user.runSql(sql);
            }

            sql = "SELECT * FROM " + tableName + " LIMIT 2;";
            logger.info(logPrefix + " " + sql);
            user.runSql(sql);

            boolean ctas_table_created = false;
            while (!ctas_table_created) {
              ctas_table_created = true;
              try {
                sql = "SELECT COUNT(*) FROM " + ctasTableName + ";";
                logger.info(logPrefix + " VALIDATE " + sql);
                user.sqlValidate(sql);
              } catch (TDBException e) {
                if (e.getError_msg().indexOf("not found") != -1) {
                  Thread.sleep(1000);
                  ctas_table_created = false;
                } else {
                  throw e;
                }
              }
            }

            sql = "DELETE FROM " + ctasTableName + " WHERE y = " + rand.nextInt(num_rows)
                    + ";";
            logger.info(logPrefix + " " + sql);
            user.runSql(sql);

            if (threadId == 0) {
              sql = "ALTER TABLE " + tableName + " ADD COLUMN n TEXT ENCODING DICT(8);";
              logger.info(logPrefix + " VALIDATE " + sql);
              user.runSql(sql);

              sql = "INSERT INTO " + tableName + " VALUES "
                      + "(" + tid + "," + tid + "," + tid + "," + tid + "," + tid + ","
                      + tid + "," + tid + "," + (tid % 2 == 0 ? "'value_1'" : "'value_2'")
                      + ", 'z');";
              logger.info(logPrefix + " " + sql);
              user.runSql(sql);
            }

            sql = "INSERT INTO " + ctasTableName + " (SELECT x, y, deci, str FROM "
                    + tableName + " WHERE str = '"
                    + text_values[rand.nextInt(text_values.length)] + "');";
            logger.info(logPrefix + " " + sql);
            user.runSql(sql);

            sql = "UPDATE " + tableName + " SET str = (SELECT count(*) > 0 FROM "
                    + tableName + ");";
            logger.info(logPrefix + " " + sql);
            user.runSql(sql);

            sql = "TRUNCATE TABLE " + tableName + ";";
            logger.info(logPrefix + " " + sql);
            user.runSql(sql);

          } catch (Exception e) {
            logger.error(logPrefix + " Caught Exception: " + e.getMessage(), e);
            exceptions[threadId] = e;
          }
        }
      });
      t.start();
      threads.add(t);
    }

    for (Thread t : threads) {
      t.join();
    }

    HeavyDBTestClient dba =
            HeavyDBTestClient.getClient("localhost", 6274, db, dbaUser, dbaPassword);
    dba.runSql("DROP TABLE " + tableName + ";");

    for (Exception e : exceptions) {
      if (null != e) {
        logger.error("Exception: " + e.getMessage(), e);
        throw e;
      }
    }
  }

Here is the caller graph for this function:

void com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.testConcurrency ( ) throws Exception

inline

Definition at line 213 of file CtasItasSelectUpdelConcurrencyTest.java.

References com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.runTest().

                                                 {
    logger.info("CtasItasSelectUpdelConcurrencyTest()");

    HeavyDBTestClient su = HeavyDBTestClient.getClient(
            "localhost", 6274, "heavyai", "admin", "HyperInteractive");
    su.runSql("CREATE USER dba (password = 'password', is_super = 'true');");
    su.runSql("CREATE USER bob (password = 'password', is_super = 'false');");

    su.runSql("GRANT CREATE on DATABASE heavyai TO bob;");

    su.runSql("CREATE DATABASE db1;");
    su.runSql("GRANT CREATE on DATABASE db1 TO bob;");
    su.runSql("GRANT CREATE VIEW on DATABASE db1 TO bob;");
    su.runSql("GRANT DROP on DATABASE db1 TO bob;");
    su.runSql("GRANT DROP VIEW on DATABASE db1 TO bob;");

    runTest("db1", "admin", "HyperInteractive", "admin", "HyperInteractive");
    // TODO: run some tests as bob

    su.runSql("DROP DATABASE db1;");
    su.runSql("DROP USER bob;");
    su.runSql("DROP USER dba;");

    logger.info("CtasItasSelectUpdelConcurrencyTest() done");
  }

Here is the call graph for this function:

Member Data Documentation

final Logger com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.logger

staticpackage

Initial value:

=
          LoggerFactory.getLogger(CtasItasSelectUpdelConcurrencyTest.class)

Definition at line 28 of file CtasItasSelectUpdelConcurrencyTest.java.

final String [] com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.text_values

staticpackage

Initial value:

= {"foo",
          "bar",
          "hello",
          "world",
          "a",
          "b",
          "c",
          "d",
          "e",
          "f",
          "g",
          "h",
          "i",
          "j",
          "k",
          "l",
          "m",
          "n",
          "o",
          "p"}

Definition at line 31 of file CtasItasSelectUpdelConcurrencyTest.java.

Referenced by com.mapd.tests.CtasItasSelectUpdelConcurrencyTest.runTest().

---

The documentation for this class was generated from the following file:

• /home/jenkins-slave/workspace/core-os-doxygen/java/utility/src/main/java/com/mapd/tests/CtasItasSelectUpdelConcurrencyTest.java