945e8c6064
YARN-9394. Use new API of RackResolver to get better performance. Contributed by Lantao Jin.
2019-04-04 18:05:01 +08:00
a92806d05a
HDDS-1189. Recon Aggregate DB schema and ORM. Contributed by Siddharth Wagle.
2019-04-04 17:33:37 +08:00
eb03f7c419
YARN-9303 Username splits won't help timelineservice.app_flow table. Contributed by Prabhu Joseph.
2019-04-03 22:53:05 -07:00
f09a78f73f
HDDS-1339. Implement ratis snapshots on OM ( #651 )
2019-04-03 22:50:28 -07:00
7b5b783f66
HDFS-14327. Using FQDN instead of IP to access servers with DNS resolving. Contributed by Fengnan Li.
2019-04-03 16:11:13 -07:00
4e64f8d763
HDDS-1324. TestOzoneManagerHA tests are flaky ( #676 )
2019-04-03 16:02:19 -07:00
358f7f9b99
HDDS-1211. Test SCMChillMode failing randomly in Jenkins run ( #543 )
2019-04-03 15:02:00 -07:00
8ff41d6243
HDDS-1358 : Recon Server REST API not working as expected. ( #668 )
2019-04-03 14:52:06 -07:00
e62cbcbc83
HADOOP-16011. OsSecureRandom very slow compared to other SecureRandom implementations. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-04-03 14:29:52 -07:00
366186d999
HADOOP-16233. S3AFileStatus to declare that isEncrypted() is always true ( #685 )
...
This is needed to fix up some confusion about caching of job.addCache() handling of S3A paths; all parent dirs -the files are downloaded by the NM without using the DTs of the user submitting the job. This means that when you submit jobs to an EC2 cluster with lower IAM permissions than the user, cached resources don't get downloaded and the job doesn't start.
Production code changes:
* S3AFileStatus Adds "true" to the superclass's encrypted flag during construction.
Tests
* Base AbstractContractOpenTest can control whether zero byte files created in tests are encrypted. Not done via an XML attribute, just a subclass point. Thoughts?
* Verify that the filecache considers paths to not have the permissions which trigger reduce-privilege downloads
* And extend ITestDelegatedMRJob to test a completely different bucket (open street map), to verify that cached resources do get their tokens picked up
Docs:
* Advise FS developers to say all files are encrypted. It's otherwise harmless and it'll stop other people seeing impossible to debug error messages on app launch.
Contributed by Steve Loughran.
Change-Id: Ifaae4c9d735ccc5eafeebd2584b65daf2d4e5da3
2019-04-03 21:23:40 +01:00
59022b28b7
HDDS-1330 : Add a docker compose for Ozone deployment with Recon. ( #669 )
2019-04-03 13:20:51 -07:00
d7979079ea
HADOOP-16210. Update guava to 27.0-jre in hadoop-project trunk. Contributed by Gabor Bota.
2019-04-03 12:59:39 -06:00
d6c233fce6
HDDS-1377. OM failed to start with incorrect hostname set as ip address in CSR. ( #683 )
2019-04-03 11:53:51 -07:00
be488b6070
HDFS-10477. Stop decommission a rack of DataNodes caused NameNode fail over to standby. Contributed by yunjiong zhao and Wei-Chiu Chuang.
2019-04-03 11:00:59 -07:00
3b0c5016b2
HDFS-14394: Add -std=c99 / -std=gnu99 to libhdfs compile flags
...
Signed-off-by: Todd Lipcon <todd@apache.org>
2019-04-03 10:56:33 -07:00
7cd7045eea
HDDS-1164. Add New blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi.
2019-04-03 22:19:10 +05:30
002dcc4ebf
YARN-4901. QueueMetrics needs to be cleared before MockRM is initialized. Contributed by Peter Bacsko.
2019-04-03 18:57:28 +05:30
8b6deebb1d
HADOOP-16232. Fix errors in the checkstyle configration xmls. Contributed by Wanqiang Ji.
2019-04-03 19:35:02 +09:00
f96fb05a2b
HDDS-1365. Fix error handling in KeyValueContainerCheck. Contributed by Supratim Deka.
2019-04-03 14:01:30 +08:00
aaaf856f4b
HADOOP-16226. new Path(String str) does not remove all the trailing slashes of str
2019-04-03 13:16:59 +09:00
cf268114c9
HDFS-13960. hdfs dfs -checksum command should optionally show block size in output. Contributed by Lokesh Jain.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-04-02 12:24:55 -07:00
bfc90bdc64
HDDS-1355. Only FQDN is accepted for OM rpc address in secure environment. Contributed by Ajay Kumar.
...
Closes #677
2019-04-02 15:43:01 +02:00
aeb43dfba3
HDDS-1153. Make tracing instrumentation configurable
...
Closes #673
2019-04-02 14:21:47 +02:00
d31c86892e
HDDS-1337. Handle GroupMismatchException in OzoneClient. Contributed by Shashikant Banerjee.
2019-04-02 16:32:30 +08:00
61d19110d4
HADOOP-16218. Findbugs warning of null param to non-nullable method in Configuration with Guava update. ( #655 )
...
Change-Id: I461e518ce9a4730b91a8138ad55b39e9a4b0a4b8
2019-04-02 09:15:11 +01:00
2f752830ba
YARN-9214. Add AbstractYarnScheduler#getValidQueues method to remove duplication. Contributed by Wanqiang Ji.
2019-04-01 20:05:15 -07:00
ebd0d21538
HADOOP-16225. Fix links to the developer mailing lists in DownstreamDev.md. Contributed by Wanqiang Ji.
2019-04-02 10:51:47 +09:00
ab2bda57bd
YARN-9428. Add metrics for paused containers in NodeManager. Contributed by Abhishek Modi.
2019-04-01 14:21:17 -07:00
da7f8c244d
YARN-9431. Fix flaky junit test fair.TestAppRunnability after YARN-8967. Contributed by Wilfred Spiegelenburg.
2019-04-01 11:21:31 -07:00
332cab5518
YARN-9418. ATSV2 /apps//entities/YARN_CONTAINER rest api does not show metrics. Contributed by Prabhu Joseph.
2019-04-01 11:06:51 -07:00
b0d24ef39c
YARN-9227. DistributedShell RelativePath is not removed at end. Contributed by Prabhu Joseph.
2019-04-01 10:59:14 -07:00
856cbf62d3
MAPREDUCE-7190. Add SleepJob additional parameter to make parallel runs distinguishable. Contributed by Adam Antal.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-04-01 10:25:38 -07:00
04f1db8936
HDDS-1260. Create Recon Server lifecyle integration with Ozone. ( #643 )
2019-04-01 09:59:32 -07:00
35b0a381e7
YARN-9255. Improve recommend applications order and fix findbugs warnings. Contributed by Eric Yang
2019-04-01 09:21:36 -07:00
36756703f0
HDDS-1322. Hugo errors when building Ozone ( #671 )
2019-04-01 08:52:05 -07:00
5f951ea2e3
HDDS-1255. Refactor ozone acceptance test to allow run in secure mode
2019-04-01 17:04:28 +02:00
0df949202a
HDDS-1067 . freon run on client gets hung when two of the datanodes are down in 3 datanode cluster. Contributed by Nilotpal Nandi.
2019-04-01 19:02:56 +05:30
8bfef21efa
HDDS-1360. Invalid metric type due to fully qualified class name. Contributed by Doroszlai, Attila.
2019-04-01 19:26:44 +08:00
ef5de29243
HDDS-1312. Add more unit tests to verify BlockOutputStream functionalities. Contributed by Shashikant Banerjee.
2019-04-01 16:09:58 +05:30
509f31b109
HDDS-1295. Add MiniOzoneChaosCluster to mimic long running workload in a unit test environment. Contributed by Mukul Kumar Singh.
2019-04-01 15:50:03 +05:30
53a86e2b8e
HADOOP-16220. Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project
...
This closes #665
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-04-01 13:49:37 +09:00
35ff31dd94
HDFS-14355 : Implement HDFS cache on SCM by using pure java mapped byte buffer. Contributed by Feilong He.
2019-03-30 23:33:25 -07:00
bf3b7fd732
HDDS-1288. SCM - Failing test on trunk that waits for HB report processing. Contributed by Siddharth Wagle.
2019-03-30 10:54:45 -07:00
ec82e4cab2
HDDS-1357. ozone s3 shell command has confusing subcommands ( #663 )
2019-03-30 10:13:29 -07:00
d9e9e5657d
YARN-9348. Application catalog build system bug fixes. Contributed by Eric Yang
2019-03-29 13:51:21 -07:00
7ee32a2eb1
YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang
2019-03-29 13:51:21 -07:00
56f1e131ec
YARN-9270. Minor cleanup in TestFpgaDiscoverer. Contributed by Peter Bacsko.
2019-03-29 10:58:56 -07:00
7dc0ecc446
[HDDS-1351] NoClassDefFoundError when running ozone genconf (). Contributed by Doroszlai Attila.
...
This closes #659 .
2019-03-29 09:01:56 -07:00
6186ed94b9
HDDS-1300. Optimize non-recursive ozone filesystem apis. Contributed by Lokesh Jain.
2019-03-29 19:27:29 +05:30
82769ba1b8
HDDS-1352. Remove unused call in TestStorageContainerManagerHttpServer.
...
Signed-off-by: Nanda kumar <nanda@apache.org>
2019-03-29 17:26:48 +05:30
Weiwei Yang
Yiqun Lin
Vrushali C
Hanisha Koneru
Inigo Goiri
Bharat Viswanadham
avijayanhwx
Siyao Meng
Steve Loughran
Gabor Bota
Xiaoyu Yao
Wei-Chiu Chuang
Sahil Takiar
Shashikant Banerjee
Sunil G
Akira Ajisaka
Lokesh Jain
Ajay Kumar
Kitti Nanasi
Yufei Gu
Giovanni Matteo Fumarola
Adam Antal
Vivek Ratnavel Subramanian
Billie Rinaldi
Doroszlai, Attila
Uma Maheswara Rao G
Elek, Márton
Devaraj K
Shweta Yakkali