Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,290 Commits 326 Branches 371 Tags
Commit Graph

9290 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
948dd27960 HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. (Contributed by Walter Su) 2016-02-10 03:52:42 +09:00
Akira Ajisaka
2a46d9c6c4 HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi. 
(cherry picked from commit 60d2011b7c0fe55b8bc44a141660d3e2df37a68d)
(cherry picked from commit cb53dfcc95ca9f6c45482600b52758bc096810b9)
 2016-02-10 03:33:31 +09:00
Jason Lowe
f264939c47 YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. Contributed by zhihai xu 
(cherry picked from commit 333f9a896d8a4407ce69cfd0dc8314587a339233)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-02-09 16:51:36 +00:00
Jason Lowe
6257ed8431 MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu 
(cherry picked from commit aa5b15b03be61ebb76a226e0de485d5228c8e3d0)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2016-02-09 16:33:07 +00:00
Zhe Zhang
ef05096f95 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
(cherry picked from commit ef3f3f6bb14cf44bef1778f1091d8ed8a4b764a3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-09 10:42:21 +08:00
Sangjin Lee
20e013cac8 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee) 
(cherry picked from commit 58acbf940a92ef8a761208a7a743175ee7b3377d)
 2016-02-08 14:00:19 -08:00
Kihwal Lee
dfea9c711d HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla. 
(cherry picked from commit 49e176c29f95c179c0f6b07d4d582e6a771a96bd)
 2016-02-05 15:50:42 -06:00
Haohui Mai
cb3aa41f53 HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 11:36:12 -08:00
Kihwal Lee
c10bf788eb HDFS-9730. Storage ID update does not happen when there is a layout change. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 496f33de0ce80dc455cfd51f19612da6f9b914f9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataStorage.java
 2016-02-04 13:32:11 -06:00
Vinayakumar B
bef53683b6 HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B) 
(cherry picked from commit ddcd6954d03d3caadc8b69f7b886a3a17c3c9d0c)
(cherry picked from commit 8cdfdbf815bf89eee3184ec7cd00e1924c1ea316)
 2016-02-04 13:20:27 +05:30
Kihwal Lee
dd11c8274d HDFS-9743. Fix TestLazyPersistFiles#testFallbackToDiskFull in branch-2.7. Contributed by Kihwal Lee. 2016-02-03 12:51:01 -06:00
Sangjin Lee
5131ee56a6 HADOOP-12761. incremental maven build is not really incremental (sjlee) 
(cherry picked from commit 4dc0a3949386ce2961356143a5a843dd537829dc)
 2016-02-03 09:03:03 -08:00
Vinayakumar B
af9de19cfd HDFS-9740. Use a reasonable limit in DFSTestUtil.waitForMetric() (Contributed by Chang Li) 
(cherry picked from commit eb2fb943fd97c191fd7c4f5333087a28ee5c87d8)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

(cherry picked from commit 6941e2ccbf6f4c7c8663a68c7a7c9ed59bb49fbf)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
 2016-02-03 11:24:26 +05:30
Junping Du
bfee573baf Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:19:08 -08:00
Jason Lowe
7f6d150c9a MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong 
(cherry picked from commit 43e669b22d9ac0b81ab8cc397c5d6d92bac986c6)
 2016-02-02 19:32:37 +00:00
Colin Patrick Mccabe
449d2ad85c HDFS-9669. TcpPeerServer should respect ipc.server.listen.queue.size (Elliot Clark via cmccabe) 
(cherry picked from commit 2da03b48eba53d4dec2a77209ad9835d808171d1)
(cherry picked from commit 60d3a3c30b05fdeec5cc369a698297ee309d620e)
(cherry picked from commit c4c94e1cf2a8e03ee7888c69a7dd8f2b7e2df14d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
 2016-02-02 11:17:28 -08:00
Kihwal Lee
2f031830e8 HDFS-9072. Fix random failures in TestJMXGet. Contributed by J.Andreina. 2016-02-02 11:07:48 -06:00
Yongjun Zhang
3d88293dda HDFS-9406. FSImage may get corrupted after deleting snapshot. (Contributed by Jing Zhao, Stanislav Antic, Vinayakumar B, Yongjun Zhang) 
(cherry picked from commit 34ab50ea92370cc7440a8f7649286b148c2fde65)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java

(cherry picked from commit fc8d9cc758d4119064d67008432f63a590b5f67a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/DirectoryWithSnapshotFeature.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/snapshot/TestSnapshotDeletion.java
 2016-02-01 15:29:03 -08:00
Jason Lowe
6b6167d401 YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla 2016-02-01 23:18:44 +00:00
Jason Lowe
69c61fae0c MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong 
(cherry picked from commit 59a212b6e1265adfa9b55c71b65a22157dfccf77)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2016-02-01 16:10:56 +00:00
Jason Lowe
ff04a18f00 YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li 2016-01-29 22:01:36 +00:00
Tsz-Wo Nicholas Sze
672481e28c HDFS-9654. Code refactoring for HDFS-8578. 2016-01-28 11:09:05 +08:00
Jian He
a1b75ff8c5 MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du 
(cherry picked from commit da18bbedaffad1f3ac9c078675583e7cfb68790f)
 2016-01-27 13:20:16 -08:00
Vinayakumar B
07704aab84 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071.(Contributed by Tsz Wo Nicholas Sze) 2016-01-26 21:34:07 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
34c9289f6c Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
 2016-01-25 15:48:18 -08:00
Jason Lowe
7d046dd375 YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R. 
(cherry picked from commit 50bd067e1d63d4c80dc1e7bf4024bfaf42cf4416)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-25 16:32:57 +00:00
Jason Lowe
6cf2fa36b3 Revert "YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R." 
This reverts commit face83775bbfd4fd0387404461dfc963729164c1.

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-25 16:26:00 +00:00
Walter Su
70e53cf746 HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 6eacdea0e475b4fff91cedce5005a7c11749cf64)
 2016-01-25 19:43:31 +08:00
Akira Ajisaka
985d1b0fa5 HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 
(cherry picked from commit 643227927a7d7974655627d7e97aae42600692ae)
(cherry picked from commit 38ec290455a61a53f1f2c8fcc06f914de52fd5e2)
 2016-01-25 14:00:17 +09:00
Jason Lowe
9601a3b2ce YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen 
(cherry picked from commit 46e5ea81e0e41646ba02391aea31481ead28aaf8)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-22 21:58:12 +00:00
Junping Du
83fd33d5fe YARN-4623. TestSystemMetricsPublisher#testPublishAppAttemptMetricsForUnmanagedAM fails with NPE on branch-2.7. Contributed by Naganarasimha G R. 2016-01-21 10:54:32 -08:00
Jason Lowe
63bb912749 YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe 2016-01-21 18:35:24 +00:00
Jason Lowe
bade7f06e8 YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R 2016-01-21 15:43:23 +00:00
Kihwal Lee
e160ddfb8d HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 
(cherry picked from commit 7b70500484574a565dd8cd5c7d8b5bc7c6d91154)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-01-21 09:34:29 -06:00
Vinayakumar B
ca29933405 HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI) 
(cherry picked from commit b7372b7166a13111b98794602ca4c166dfd78d29)
(cherry picked from commit 845acfd96c8461ebb412cd1daec51e89ce9f1c18)
 2016-01-21 19:21:00 +05:30
Vinayakumar B
eb3dcc0739 HDFS-9661. Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw (Contributed by ade) 
(cherry picked from commit 14255786908f991fd2022480fe5575533a3dc7ce)
 2016-01-20 21:11:39 +05:30
Tsz-Wo Nicholas Sze
2131b9820d In CHANGES.txt, move HDFS-9294 to Release 2.6.4. 2016-01-16 23:48:03 +08:00
Jason Lowe
296ecbd5ec MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt 2016-01-15 16:59:44 +00:00
Junping Du
f7d3870034 YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee. 
(cherry picked from commit fc6d3a3b234efff2b0b646c31a4e6ff0a5118ef9)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
(cherry picked from commit e09222306f65227d14fe1e656102d225b232409c)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-15 09:02:51 -08:00
Jason Lowe
d01362f10f YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki. 
(cherry picked from commit 435f935ba7d8abb1a35796b72d1de906ded80592)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-01-15 16:13:04 +00:00
Jason Lowe
dbed88237c HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe 
(cherry picked from commit cdf88952599a43b1ef5adda792bfb195c7529fad)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-14 23:52:10 +00:00
Jason Lowe
4976aac46e HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma) 
(cherry picked from commit 8e1bdc17d9134e01115ae7c929503d8ac0325207)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-14 23:34:29 +00:00
Arpit Agarwal
6cd5fcb634 HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:19:51 -08:00
Yongjun Zhang
7a550db931 HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 817cc1f02a60ef4e372171415058fdc76c0d2e39)
 2016-01-14 12:45:42 -08:00
Kihwal Lee
a90dcb0865 Fix up CHANGES.txt 2016-01-14 09:58:35 -06:00
Junping Du
c2d1d69525 Fix yarn CHANGES.txt entry for 2.7.2 2016-01-14 06:17:42 -08:00
Junping Du
0e0272f120 Add missing CHANGES.txt entry for HDFS-8767. 
(cherry picked from commit e50dd19a9c816c81c64fff8b958f4036dcb98822)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit 62eabec549ef13ac7e6ed517ef628b5b01d0ab77)
 2016-01-14 06:14:56 -08:00
Akira Ajisaka
b1ee278428 MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt. 
(cherry picked from commit 7b0964f354e90968c2dac2f7acc17214732aed64)
(cherry picked from commit 6efee8907af3f21d8526927cf5e676d9922b686b)
 2016-01-14 10:42:02 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f93f912969 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
Putting CHANGES.txt entry under 2.6.3 after the backport.

(cherry picked from commit e3e09aa1e75905db1fe377bad04756eadf1fc632)
 2016-01-13 15:08:13 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
faebc20e26 HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa) 
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753dab836105247945392ad4e43695a50bc)
 2016-01-13 14:56:58 -08:00