Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,736 Commits 326 Branches 371 Tags
Commit Graph

10736 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xiaoyu Yao
4d9efaf3b0 HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu. 
(cherry picked from commit f3427d3766d7101d0d1c37d6281918551d221ebe)
 2016-01-21 13:55:42 -08:00
Zhe Zhang
22caeb1c0a HDFS-9674. The HTrace span for OpWriteBlock should record the maxWriteToDisk time. Contributed by Colin McCabe. 
Change-Id: I9bf3f3bcd57f5880189ad7c160f3dd66f97d904b
 2016-01-21 13:26:54 -08:00
Jing Zhao
c19bdc1926 HDFS-9542. Move BlockIdManager from FSNamesystem to BlockManager. Contributed by Jing Zhao. 
(cherry picked from commit c304890c8c7782d835896859f5b7f60b96c306c0)
 2016-01-21 11:37:24 -08:00
Jason Lowe
d051200a62 YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe 
(cherry picked from commit 468a53b22f4ac5bb079dff986ba849a687d709fe)
 2016-01-21 18:32:47 +00:00
Akira Ajisaka
cd5c66b080 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey. 
(cherry picked from commit 2ac39ca762fd7e47b7b9a7b3308b31138b0f59be)
 2016-01-22 02:45:54 +09:00
Akira Ajisaka
bf4901c609 YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki. 
(cherry picked from commit d3224e2d6274daf73a103c0dbe21ba69add7ca26)
 2016-01-22 02:14:53 +09:00
Karthik Kambatla
5c2f495fcc YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha) 
(cherry picked from commit 4992398aeeb213ce59e068b0226e22e49ce559eb)
 2016-01-21 17:43:49 +01:00
Jason Lowe
4e6fc3ca18 YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R 
(cherry picked from commit f858ac24269c101bdee1f7b7b2566bdbda2b4ecd)
 2016-01-21 15:39:51 +00:00
Kihwal Lee
3d8d8f1497 HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 
(cherry picked from commit 7b70500484574a565dd8cd5c7d8b5bc7c6d91154)
 2016-01-21 09:33:30 -06:00
Vinayakumar B
c13929b385 HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal) 
(cherry picked from commit 446987e20aacd870e1bc3f950b2bd4bbda1f9571)
 2016-01-21 20:10:11 +05:30
Vinayakumar B
845acfd96c HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI) 
(cherry picked from commit b7372b7166a13111b98794602ca4c166dfd78d29)
 2016-01-21 19:18:36 +05:30
Masatake Iwasaki
54df2a4352 HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims) 
(cherry picked from commit 9eec6cbedcc53e6dd306a4a578a22937ae239260)
 2016-01-21 18:17:03 +09:00
Wangda Tan
9512866740 YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda) 
(cherry picked from commit c9fe0371a8ab40c0d3437fadd32788b320788a7a)
 2016-01-21 11:16:58 +08:00
Xuan
66b030f608 YARN-4611. Fix scheduler load simulator to support multi-layer network 
location. Contributed by Ming Ma.

(cherry picked from commit 1708a4cd2377c56e2cb5738720b7eaf10baf13c8)
 2016-01-20 15:43:02 -08:00
Xuan
be3322792f YARN-4559. Make leader elector and zk store share the same curator 
client. Contributed by Jian He

(cherry picked from commit 890a2ebd1af51d24ccbbc5d1d65d17b24ad8ab9b)
 2016-01-20 14:49:04 -08:00
Lei Xu
c57f55223c HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 
(cherry picked from commit 2ec438e8f7cd77cb48fd1264781e60a48e331908)
 2016-01-20 14:26:47 -08:00
Colin Patrick Mccabe
c56044b9ee HDFS-9576: HTrace: collect position/length information on read operations (zhz via cmccabe) 
(cherry picked from commit 7905788db94d560e6668af0d4bed22b326961aaf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
 2016-01-20 11:27:51 -08:00
Vinayakumar B
252bf56e59 HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade) 
(cherry picked from commit 14255786908f991fd2022480fe5575533a3dc7ce)
 2016-01-20 21:05:44 +05:30
Yongjun Zhang
a5ee4c09de HDFS-6054. MiniQJMHACluster should not use static port to avoid binding failure in unit test. (Yongjun Zhang) 
(cherry picked from commit 57d0a94305b22a469062c7ce85b3159fee17a28b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/qjournal/MiniQJMHACluster.java
 2016-01-19 23:13:46 -08:00
Ravi Prakash
2cbb8bbd72 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano 
(cherry picked from commit 1acc509b45d58c0eb7e83ea1ba13169410be0dbe)
 2016-01-19 14:00:54 -08:00
Wangda Tan
23deeb4230 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)
 2016-01-19 21:28:51 +08:00
Jian He
bb2a9a78c0 YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan 2016-01-18 21:05:03 -08:00
Akira Ajisaka
3a8d372518 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki. 
(cherry picked from commit 92c5f565fd5466eab4496c2413de2e8b2897a91f)
 2016-01-19 13:31:48 +09:00
Wangda Tan
704b37d0e1 YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 
(cherry picked from commit a44ce3f14fd940601f984fbf7980aa6fdc8f23b7)
 2016-01-19 09:31:13 +08:00
Wangda Tan
1625281ccb Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" 
This reverts commit 3fe57285635e8058c34aa40a103845b49ca7d6ff.

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 150f5ae0343e872ee8bef39c57008c1389f0ba9e)
 2016-01-19 09:31:07 +08:00
Jian He
6db022fc48 YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu 2016-01-18 16:59:04 -08:00
cnauroth
62d6166211 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth. 
(cherry picked from commit 8bc93db2e7c64830b6a662f28c8917a9eef4e7c9)
 2016-01-18 09:09:05 -08:00
rohithsharmaks
da887e4252 YARN-4265 Addendum patch to fix compilation issue caused by project version number 2016-01-18 16:38:41 +05:30
Karthik Kambatla
ef59521094 YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha) 
(cherry picked from commit d40859fab1ad977636457a6cc96b6a4f9b903afc)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapred/TestTaskAttemptListenerImpl.java
 2016-01-18 10:59:34 +01:00
Wangda Tan
c56d46307a Move YARN-4524 from 2.9 to 2.8 2016-01-18 17:04:41 +08:00
Wangda Tan
552f15739c YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda) 
(cherry picked from commit b08ecf5c7589b055e93b2907413213f36097724d)
 2016-01-18 11:16:04 +08:00
Wangda Tan
6dab78c71a YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) 
(cherry picked from commit 805a9ed85eb34c8125cfb7d26d07cdfac12b3579)
 2016-01-18 11:15:59 +08:00
Wangda Tan
c1193b46d4 YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda) 
(cherry picked from commit 9523648d57ebc71cf5c57f3f8c52c4a63265b61c)
 2016-01-18 11:15:53 +08:00
Junping Du
4a30a44b11 YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe 
(cherry picked from commit 02f597c5db36ded385413958bdee793ad7eda40e)
 2016-01-17 17:38:42 -08:00
cnauroth
2b9ea68ef8 HADOOP-12691. Move files to correct location. 
(cherry picked from commit da77f423d142c4dda8810d4668edde3c7d2999e8)
 2016-01-16 07:47:52 -08:00
Tsz-Wo Nicholas Sze
87779a4478 In CHANGES.txt, move HDFS-9294 to Release 2.6.4. 2016-01-16 23:46:19 +08:00
Colin Patrick Mccabe
c33603be36 HADOOP-12662. The build should fail if a -Dbundle option fails (Kai Zheng via cmccabe) 
(cherry picked from commit 2a303865391657648281270114bccc32fd4c051a)

Conflicts:
	BUILDING.txt
	hadoop-common-project/hadoop-common/src/CMakeLists.txt
	hadoop-project-dist/pom.xml
 2016-01-15 14:10:13 -08:00
Colin Patrick Mccabe
48b8c99479 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) 
(cherry picked from commit b2c155f810888480d058512a326a5083e1bb4eaa)
 2016-01-15 13:22:14 -08:00
Andrew Wang
2a6224aa0f HADOOP-12713. Disable spurious checkstyle checks. 
(cherry picked from commit 5d5a22a878d185dd996a921d681863c4bc44e6b8)
 2016-01-15 11:58:58 -08:00
Andrew Wang
46323d7744 HDFS-9624. DataNode start slowly due to the initial DU command operations. (Lin Yiqun via wang) 
(cherry picked from commit c07f7fa8ff752436726239d938e0461236839acf)
 2016-01-15 11:28:55 -08:00
Yongjun Zhang
ee012c1f6f HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit a9c69ebeb707801071db3cc22bfcd14f87be443a)
 2016-01-15 10:10:28 -08:00
rohithsharmaks
d3c08cde68 YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks) 2016-01-15 22:46:21 +05:30
Jason Lowe
5923f50797 MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt 
(cherry picked from commit 9fbd579ab50f051c8ad63d316ca5a3e24822dcdd)
 2016-01-15 16:53:34 +00:00
Junping Du
e09222306f YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee. 
(cherry picked from commit fc6d3a3b234efff2b0b646c31a4e6ff0a5118ef9)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-15 08:43:30 -08:00
Akira Ajisaka
a2d0c8ff9c Move HADOOP-12590 from 2.9.0 to 2.8.0 in CHANGES.txt. 
(cherry picked from commit 1da762c745fa2bbb0a7a6d16bdc58ec9d4eb670d)
 2016-01-15 10:48:58 +09:00
Jason Lowe
81cda7608b HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe 
(cherry picked from commit cdf88952599a43b1ef5adda792bfb195c7529fad)
 2016-01-14 23:47:29 +00:00
Jason Lowe
86456b01eb Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6 
(cherry picked from commit 651c23e8ef8aeafd999249ce57b31e689bd2ece6)
 2016-01-14 23:42:58 +00:00
Arpit Agarwal
aadcaf4f32 HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:18:00 -08:00
Yongjun Zhang
cfeecf113b HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 817cc1f02a60ef4e372171415058fdc76c0d2e39)
 2016-01-14 12:45:18 -08:00
cnauroth
9600736d89 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay. 
(cherry picked from commit 06f4ac0ccdc623283106f258644148d5e003f75c)
 2016-01-14 11:56:11 -08:00