/
.Big Data Team JIRA Current Work Status - Feb 2019 v1.0

.Big Data Team JIRA Current Work Status - Feb 2019 v1.0

Feb 26, 2019


InitiativeEpicStorySummaryStatusFix Version/s
LDCG-108

Build, Port, Verify, Automate CI, Benchmark and profile Big Data ComponentsIn ProgressONGOING

LDCG-758
ScyllaDBTo Do2019.12


LDCG-766Run Scylla on Fedora26In Progress2019.07


LDCG-767Run Scylla on Ubuntu-18.04Open2019.07

LDCG-786
ArangoDBOpen2019.12

LDCG-775
Apache KnoxTo Do2019.12

LDCG-788
Apache MetronOpen2019.12

LDCG-784
Apache ArrowIn Progress2019.02

LDCG-756
Apache AmbariTo Do2018.12


LDCG-717Create Bigtop mpack as a stack for Apache AmbariIn Progress2019.07


LDCG-180Upstream Apache Ambari changes needed for AArch64 buildReview2019.07

LDCG-737
Apache BeamTo Do2019.06

LDCG-252
Apache KafkaTo Do2019.06


LDCG-675Kafka Streams - Test and capture performanceTo Do2019.06

LDCG-250
Apache FlinkTo Do2018.11


LDCG-799Build and test Apache Flink with Scala 2.13Open2019.07


LDCG-796Build and test Apache Flink with Openjdk11Open2019.07

LDCG-439
Apache HBASEBlocked2018.11


LDCG-816Publish Protobuf ARM64 binaries on Maven CentralUpstream Review2019.05


LDCG-809Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)Blocked2019.05

LDCG-822
Apache DrillIn Progress2019.02


LDCG-828Install and do basic testing of Apache Drill in Clustered environmentIn Progress2019.06

LDCG-868
Apache PhoenixOpen2019.09

LDCG-869
Apache KuduTo Do2019.10

LDCG-776
Apache AtlasTo Do2019.10

LDCG-863
Test Zookeeper 3.4.9 debian bitsTo Do2019.05

LDCG-793
Test Big Data components on KubernetesOpen2019.12


LDCG-780Test Running Apache Hadoop on KubernetesOpen2019.12


LDCG-781Test Running Apache Spark on KubernetesOpen2019.12

LDCG-854
CI infrastructure for Apache ArrowIn Progress2019.10


LDCG-858AArch64 infrastructure for CI for Apache Arrow projectOpen2019.10


LDCG-860Setup CI with apache Arrow projectOpen2019.10


LDCG-864Create .deb and .rpm packages for Apache ArrowOpen2019.08


LDCG-865Create docker image for Apache ArrowOpen2019.08

LDCG-124
JVM profilingOpen2019.12

LDCG-803
MiniFiOpen2019.03

LDCG-113
Establish CI Loops for Big Data ComponentsIn Progress2019.12


LDCG-740CI for Hadoop 3.1Blocked2018.12


LDCG-741CI for Hbase 2.0Blocked2018.12


LDCG-795CI for Spark with OpenJDK11Open2019.06


LDCG-798CI for Spark 2.4 with Scala 2.13Open2019.06


LDCG-807CI for CassandraOpen2019.05


LDCG-547CI for ELKClosed


LDCG-856CI for Apache DrillIn Progress2019.03


LDCG-859CI for Apache ArrowOpen2019.06


LDCG-807CI for Apache CassandraOpen2019.07

LDCG-861
Create docker image for Apache DrillOpen2019.06

LDCG-857
Linaro Connect Demo using Apache DrillIn Progress2019.04


LDCG-829Import git commit dataIn Progress2019.04


LDCG-866Setup Drill on YarnIn Progress2019.05

LDCG-772
AnacondaTo Do2018.10


LDCG-773BazelTo Do2018.10

LDCG-800
Apache SolrOpen2019.06


LDCG-801Solr with Hadoop 3Open2019.06

LDCG-805
Apache ParquetOpen2019.04

LDCG-811
Apache CassandraTo Do2019.06


LDCG-808Support unaligned memory access for Aarch64Closed2019.05


LDCG-813Cassandra_13781To Do2019.05


LDCG-812Cassandra_13881To Do2019.05


LDCG-802Cassandra DtestsTo Do2019.07

LDCG-774
Apache RangerTo Do2018.10

LDCG-806
Apache ThriftOpen2019.02

LDCG-797
Upgrade netty to use openjdk11To Do2019.08

LDCG-794
Build and test Apache Hadoop 3.2 with OpenJDK11Review2019.06

LDCG-810
HDFS-12822 HDFS unit test failure in AArch64. TestDirectoryScanner.testThrottling: Throttle is too permissiveTo Do2019.01

LDCG-118
Big Data Workload Analysis, Profile and OptimiseTo Do2019.12


LDCG-121Elasticsearch on clustered envOpen2019.03


LDCG-405Analytics for PMOOpen2019.06


LDCG-320Wikipedia workloadOpen2019.03


LDCG-122Logstash on clustered envOpen2019.03

LDCG-126
Big Data BenchmarksIn Progress2019.12


LDCG-257Spark BenchIn Progress2019.12


LDCG-322TestDFSIOOpen2019.12


LDCG-321SWIMOpen2019.12


LDCG-323NNBenchOpen2019.12


LDCG-325TPC-CTo Do2019.12


LDCG-328GridMix3Open2019.12


LDCG-324TPCx-HSTo Do2019.12


LDCG-326MRBenchOpen2019.12


LDCG-317TPC-HOpen2019.12


LDCG-130AMPLabOpen2019.12


LDCG-128HiBenchIn Progress2019.12


LDCG-125TeraGen + TerasortClosed


LDCG-316TPC-DSOpen2019.12

LDCG-823
Setup 4 THX2 for bigdata workload testingIn Progress2019.03
LDCG-757

Big Data Maintainership InitiativeIn ProgressONGOING

LDCG-435
Support and Maintenance of ongoing activities in BigData teamIn Progress2019.12

LDCG-406
Support ODPi as TSC memberIn Progress2019.12

LDCG-871


Upstream Review Follow up on Big Data patchesTo DoONGOING


LDCG-804Add support of ARM64 hardware crc instructions for nativetask - Hadoop MapreduceUpstream Review9/6/2018 22:35
LDCG-870

Apache Bigtop ContributionsIn ProgressONGOING

LDCG-732
Support of ongoing Apache Bigtop activitiesIn ProgressONGOING


LDCG-815BIGTOP-3029 "--parser" is invalidated in puppet v4.x. Affects Debian-9 buildsUpstream Review9/6/2018 23:07


LDCG-550Create a docker based sandbox image for Bigtop smoke tests.Open9/6/2018 17:17


LDCG-852Work on Bigtop v1.4 release definitionIn Progress2/13/2019 15:47


LDCG-867Improve Giraph deploymentResolved

LDCG-853
Create necessary smoke tests for all components of BigtopIn Progress2/13/2019 15:46


LDCG-847Crunch smoke testUpstream Review2019.03


LDCG-743Update solr smoke test to work with v6.6.0Resolved2019.03


LDCG-845Giraph smoke testResolved2019.03


LDCG-855Kafka smoke testOpen2019.03

LDCG-117
Automated CI for Smoke testsOpen2019.06

LDCG-862
Add Apache Drill to Apache Bigtop projectOpen2019.09

LDCG-112
Verify Apache Big Top Smoke TestsResolved2019.03