关闭

关闭

关闭

封号提示

内容

首页 Statistical Learning Theory - Vapnik.pdf

Statistical Learning Theory - Vapnik.pdf

Statistical Learning Theory - V…

上传者: rootxue 2010-11-07 评分 0 0 0 0 0 0 暂无简介 简介 举报

简介:本文档为《Statistical Learning Theory - Vapnikpdf》,可适用于IT/计算机领域,主题内容包含soondengStampAdaptiveandLearningSystemsforSignalProcessing,Communications,符等。

soondengStampAdaptiveandLearningSystemsforSignalProcessing,Communications,andControlEdto~:SimonHuykinWerbosTHEROOTSOFBACKPROPAGATION:FromOrderedDerivativestoNeuralNetworksandpoliticalForecastingKrshcKanellakopoulos,andKokotovic:NONLINEARANDADAPTIVECONTROLDESIGNNiluasandShaoSIGNALPROCESSINGWITHALPHASTABLEDISTRIBUTIONSANDAPPLICATIONSDiamantarasandKungPRINCIPALCOMPONENTNEURALNETWORKS:THEORYANDAPPLICATIONSTaoandKokotovic:ADAPTIVECONTROLOFSYSTEMSWITHACTUATORANDSENSORNONLINEARITIESTsoukalasFUZZYANDNEURALAPPROACHESINENGINEERINGHrycejNEUROCONTROL:TOWARDSANINDUSTRIALCONTROLMETHODOLOGYBeckemanADAPTIVECOOPERATIVESYSTEMSCherkasskyandMuherLEARNINGFROMDATA:CONCEPTS,THEORY,ANDMETHODSpassistoandBurgessSTABILITYANALYSISOFDISCRETEEVENTSYSTEMSSinchez~eiiaandSznaierROBUSTSYSTEMSTHEORYANDAPPLICATIONSVapnikSTATISTICALLEARNINGTHEORYStatisticalLearningTheoryAWtLEYINfERSCIENCEPUBLICATfONJOHNWLLfYSONS,LNC,NEWYORKCCilCHESTERjWEfNHEIMIBRISBANEjStNGAPOREITORONTOPageivDisclaimer:ThsbookcontainscharacterswithchacnticsWhenthecharacterscanberepresentedusingtheIScharacterset(http,netLibrarywillrepresentthemastheyappearintheorignaltext,andmostcomputerswillbeabletoshowthefullcharacterscorrectlyInordertokeepthetextsearchableandreadableonmostcomputers,characterswithhacriticsthatarenotpartoftheISlistwillberepresentedwithouttheirchacriticalmarksThsbookisprintedonacidfieepaper'CopynghtObyJohnWileySons,IncAllrightsreservedpublishedsimultaneouslyinCanadaNopartofth~spublicationmaybereproduced,storedinaretrievalsystemortransmittedinanyformorbyanymeans,electronic,mechanical,photocopyng,recordmg,scanningorotherwise,exceptaspermittedunderSectionsoroftheUnitedStatesCopyrightAct,withouteitherthepriorwrittenpermissionofthepublisher,orauthorizahonthroughpaymentoftheappropriatepercopyfeetotheCopynghtClearanceCenter,RosewoodDrive,Danvers,MA,(),fax()RequeststothepublisherforpermissionshouldbeaddressedtothepermissionsDepartment,JohnWileySons,Inc,ThrdAvenue,NewYork,NY,(),fax(),EMail:pERMREQWILEYCOMLibrmyofCongressCataloginginPublieutionData:Vapnik,VlahrNaurnovichStatisticallearningtheoryVladmirNVapnikpcm(Adaptiveandlearningsystemsforsignalprocessing,communications,andcontrol)IncludesbibliographcalreferencesandindexISBN(cloth:alkpaper)ComputationallearningtheoryITitleSeriesQVdcCIPprintedintheUnitedStatesofAmericaPagevInmemoryofmyfatherPagevi~CONTENTSPrefaceIntroduction:TheProhlen~ofInductionandStatidicalInferenceILearningParadigminStatisticsTwoApproachestoStatisticalInferenceParticular(I)arametncInference)andGeneral(NonparametncInference)TheParadigmCreatedbytheParametricApproachShortcomingoftheParametricParadigmAftertheClassicalParahgmTheRenassanceTheGeneralizationoftheGl~venkoCantelllKolmogorovTheoryTheStructuralR~skM~nimizationPnncipleTheManPnncipleofInferencefromaSmdSampleSlzeWhatThlsBookisAboutITheoryofLearningandGeneralizationTwoApproachestotheLeamlngProblemIGeneralModelofLearningfromExamplesTheProblemofhfinimizlngtheRiskFunchondfromEmpincdDataTheProblemofPatternRecognitionTheProblemofRegressionEstimationProblemofInterpretingResultsofIndirectMeasuringTheProblemofEensityEstimatlon(theFisherWaldSetting)InductionPrinciplesforMinimizingtheRlskFunctionalontheBasisofEmpiricalDataClassicalMethodsforSolvingtheFunctionEstimationProblemsIdentlficatlonofStochasticObjectsEst~mationoftheDensitiesandConditionalDensitiesProblemofDens~tyEst~mationDlrectSettingProblemofCondihanalProbabllltyEst~mahonProblemofConditionalDens~tyEstimationTheProblemofSolvinganApproximatelyDeterminedIntegralEquationIGhvenkoCanteltiTheoremConvergenceinProbabilityandAlmostSureConvergenceGhvenkoCantelThealemThreeImportantStatist~calLawsnlPosedProblemsTheStructureoftheLearnlngTheoryAppendixtoChapterMethodsforSolvingIPosedProblemsAlITheProblemofSolvlnganOperatorEquationAProblemsWellPased~nTlkhanovsSenseAlTheRegulx~zationMethodAlIdeaofRegularizationMethodAManTheoremsabouttheRegulxizationMethodEstimationoftheProbabilityMeasureandProblemofLemingIPrabab~l~lyModelofaRandomExperimentTheBas~cProblemofStahshcsTheBasicProblemsofProbabilityandStatisticsUniformConvergenceofProbabilityMeasureEst~matesCnnrl~i~nnsfortheTTn~formCnmr~rgenreofEstlrnatesintheTTnknnwnPrnhabllltyMeasureStructureofD~stnbut~anFunctionEstlmatarthatProvldesUniformConvergencePmilalUniformConvergenceandGeneralizationofGlivenkoCantelliTheoremDefinitionofPartialUniformConvergenceGeneralizationoftheGlivenkoCantelliProblemMmimizingtheRiskFunctionalUndertheConditionofUniformConvergenceofProbabilityMeasureEstimatesIvnimizingtheRiskFunctionalundertheConditionofPKtialUniformConvergenceofProbabilityMeasureEshmatesRemarksaboutModesofConvergenceoftheProbabilityMeasureEstimatesandStatementsoftheLearnrigProblemConditionsforConsistencyofEmplncalR~skMinimizahonPrincipleClassicalDefinitionofConsistencyDefinitionofStnct(Nontrivial)ConsistencyDefinltlonofStrictConslstencyforthePatternRecagnltionandtheRegress~onEstimationProblemsDefinltlonofStrictConslstencyfortheDensityEstlmat~anProblemEmpiricalProcessesRemarkontheLawofLxgeNumbersandItsGeneralizationTheKeyTheoremofLeamingTheory(TheoremaboutEquivalence)ProofoftheKeyThearemStnctCans~stencyaftheMax~mumL~kel~haodMethodNecessacyandSufficientConditionsforUniformConvergenceofFrequenciestotheirProbabilitiesThreeCasesofUniformConvergenceConditionsofUniformConvergenceintheSimplestModelEntropyofaSetofFunctionsThearemaboutUmformTwoS~dedConvergenceNecessaryandSufficlentCandihonsfarUmformConvergenceofMeanstotheirExpectationsforaSetofRealValuedBoundedFunctionsEntropyofaSetofRealValuedFunctionsTheoremaboutUniformTwoSidedConvergenceNecessaryandSufficlentConditionsfarUmformConvergenceofMeanstothelrExpectationsforSetsofUnboundedFunctionsProofofTheoremKantiProblemofDemarcabanandPopper'sTheoryofNonfalsiflabil~tyITheoremsaboutNonfalsiflabil~tyICaseofCompleteNonfdstfiab~lttyTheoremaboutParbdNonfalstfiabtl~tyThearemaboutPatenhalNanfals$flabtl$tyConQtoniforOneSjdedUrnformConvergenceandConstitencgoftheEmplncdPdskNnlm$rahonPnnapleThreeUlestonesInLeamlngTheoryBaundiantheRtskforIndrcatorLossFunct~oniBoundsfortheStmplestModelPess$mtst$cCaseITheSimplestModelBoundsforthcSimplestModelOpbmtsbcCaseBoundsfortheStmplestModelGeneralCaieTheBastcIneyualtheiPesstmflstflcCaseProofofTheoremITheEastcLemmaProofofBaxcLemmaTheIdeaofProvtngTheoremProofofTheoremBaxcInequallbesGeneralCaiePraafofThearemManNancontmct~reBoundsVCDtmenstonTheStmctureoftheGrowthFunchonCanitructtveDlitrtbutlonFreeBaundionGeneralnabonAb~l~tySolubonofGeneraltredGhuenkoCantell,ProblemPraafafTheoremExampleoftheVCDlmenslanaftheDifferentSetsofFuncboniRemarksabouttheBoundsontheGeneral~zahonAb~lttyofLearntngMach~nesBoundonDevtahonofFrequenctesInTwoHalfSamplesAppendrxtoChapterLowerBoundsantheRlskoftheERMPnnclpleAITwoStrategleimStahsttcalInferenceAMtntmaxLcssStrategyforLeam~ngProblemsAUpperBoundsontheMammalLossfortheEmptrtcalRtskMtn$m~zationPrincipleACptlmlibcCaseAPesslmtsttcCaseALowerBoundfortheMtntmaxLossStrategymtheOpbmtsbcCaseALowerBoundfarMmlmaxLossStrategyfarthePeiilmiihcCaieBoundsantheRtskforRealValuedLaiiFuncbaniBoundsfortheSimplestModelPesstmlsttcCaseConceptsofCapacityFartheSetsofRedVduedFunct~onsNoncanitructweBoundsonGeneral~iabanforSetsofRealValuedFuncbaniTheMatnIdeaConceptsofCapacityFortheSetofRealValuedFunct~onsBoundsfortheGeneralModelPeii$mtihcCaieTheBasicInequaliBIProofofTheoremBoundsfortheGeneralModelUniversalCaseProofofTheoremBoundsforUntFormRelattveConvergenceProofofTheoremfortheCasep>ProofofTheoremfortheCaseIcpPnorInformat~onforthePL~skMirnm~rauonProbleminSetsofUnboundedLoisFuncboniBoundsontheRiskfarSetsaFUnbaundedNonnegatieFunchonsSampleSelecttonandtheProblemoFOutltersTheMalnResultsoftheTheovofBoundsTheStruchlralRtskMtntmlzahonPnnclpleTheSchemeoftheStructuralRtskMmmmtrattonInducttonPnnctpleIPnnclpleofStructuralRiikMtnimlzabonMtnjrnumDescnpbanLengthandStructuralRiikMtmmtzabanInductivePnnclplesTheIdeaabouttheNatureofRandomPhenomenaStachasbcUlPosedProblemsIStochaittcIIIPosedProblemsRegulanzahonMethodforSolvingStochasticIllPosedProblemsProofsoftheTheoremsProofofTheoremProofofTheoremProofofTheoremConditlanifarCanitstencyoftheMethodsofDenstyEshmationNonparametncEsbmatar~ofDensstyEshmatoriBasedanAppraxmahonsoftheD~stribut~onFunchonbyanEmptncalDlstrtbutlonFunchonTheYarzenEsttmatorsPrqectlonEsttmatorsSpllneEsttmateoftheDensityApproxtmahonbySpl~neioftheOddOrderSpllneEsttmateoftheDensitvApproxtmahonbySpl~neioftheEvenOrderEsttmatorsfortheDtstrlbuttonFunctlonPolygonAppraxmattonofD~stnbuhonFuncaonPrqectlonMethodoftheDensttyEstimatorAsymptoticRateofConvergenceforSmoothDens~vFunctionsProofofTheoremChoosingaVdueofSmoothing(Regulanrabon)ParameterfortheProblemofDens~tyEshmatlonEstlmdtlonoftheRhtloofTwoDensttlesIEsttmahonofCondihonalDens~tieiIEstlmatlanafRattaofTwoDenshesontheLineEst~mhtlonofaCondihondProbabtl~vonaLmeE~tlmnhngtheValuesofFunctlonatCnvenPotntsTheSchemeofMtntmjzjngtheOverallRiskTheMethodofStructuralMlnlmtzatlanoftheOverallR~skBoundsontheUrnformRelativeDeu~htlonofFrequenc~es~nTwoSubsamplesABoundontheUntfarmRelahveDevlatlonofMeansInTwoSubsamplesEshmabanofValuesofanIndrcatarFunctlanInaClassofL~nearDecisionRulesSampleSelect~anfarEstmahngtheValuesofanIndrcatorFuncbanEshmatlonofVduesofaRedFunctlontntheClassofFunctionsLtneartnthemParametersSampleSelecttonforEsttrnahonofValuesofRedValuedFunctlonsLocalAlgonthmiforEstmahngValuesofanIndrcatorFuncbanLocalAlgonthmifarEst~mahngValuesofaRealValuedFunctionTheProblemofFtnngtheBestPointtnaCnvenSetIIChalceoftheMastProbableRepresentattveoftheFsritClaiiChalceoftheBestPamtofalvenSetISupportVectorEstimationofFuuctiourPercepkansandThetrGeneralliat~oniIRosenblauiPerceptranPProofsoftheTheoremsProofofNovtkoffTheoremProofofTheoremMethodofStochashcApproxtmat$anandStgmatdAppraxtmahonofIndrcatorFuncboniMethodofStochasticApproxtmat~onMethodofPatenttalFunctflaniandRadralBassFuncttoniMethodofPotentlaFunct~onstnAsymptottcLearn~ngTheovRaalBasisFunchonMethodThreeTheoremsofOpttmizat~onTheoqFernat'sTheorem()LqrangeMultlpltersRule()KuhnTuckerTheorem()NeuralNetworksTheBackPropqat~onMethodTheBackPropagattonAlgorithmNmalNeWoksFortheRegresslmEst~rnatlonFnoblernRmatkrontheBackqagatlonMethodTheSupportVedmMethodfarEstmahngInd~catmFunctlmsITheOptlmalHypqlaneTheOptimalHypqlmefarNons~parahleSetsTheHadMaqmGenerallrat~onoftheOptimalHyperplaneTheBaslcSolutlonSofiMarglnGenerallrahmStatisticalPropettlesoftheOphmalHyperplaneProofsoftheTheorernshoofofTheomnhoofofTheomnLeaveOneOutProcedureProofofTheomandTheoremProofofTheomProofofTheomnTheIdeaoftheSupportVectorMachlneGenaallratlonInHlghDimensionalSpaceHllbaiSchmtdtTheormdMacerTheorrmConsiructlngSVMachinesOneMoreApproachtotheSuppaltVecbrMethodMnunlzlngtheNwnberofSuppartVedmsGenaallzatlonfortheNmreparableCaseLlnearOptun~zabmMethodforSVMachmesSelectionofSVMachmeUslngBoundsExamplesofSVMachinesforPaitemRecognttlonPolynmlalSuppoitVectorMachmeaRadlalBaelsFunctionSVMach~nerTwo~LayaNeuralSVMach~neeSupportVectorMethodforTransdud~velnfaenceMult~classClass~f~cahmRemarksonGmeral~zat~onoftheSVMethodIITheSuppottVectorMethodforEstunahngRealValuedFunchonsIeInsens~t~veLossFundlonsLossA~ndtonsforRoh~rstEst~matmsMmm~zmgtheRlskwltheInsensltlveLossFunchonsMmirnlzlngtheR~rkforaFlredElementoftheShcturellTheBasicSalut~onsllSolut~onfortheHubaLossFunchonIISVMach~nesforFundlonEstlrnatlonMmunlzlngtheRiskForaFxedElementoftheShctureinFeabrfSpacellTheBaslcSolutionsmFeabreSpaceSolutionforHubaLossFundlonnFeab~reSpacellLlnearOptunlzahonMethodMulhKmelDecampas~t~anaffunchansIConstrudlngKernelsforEshrnat~onofRealValuedFund~onsKernelsGeneratrngExpanslononPolynm~alsConstructingMultidunens~onalKernelsKmelsGeneratingSplinesSpllneofOrdadwlthaFmteNumbaofKnobKanelsGmaatlngSpllneswlthanlnfinlteNumberofKnotsllB,SpllneApproxirnahonsB,Splmesw!fianInfnlleNumberoFKnotsIIKanelsrJenaatlngFourierExpansionsKanelefarRegulanzedFour~aExpms~onsTheSuppaltVedarANOVADecompoa~t~on(SVAD)forFunchmApprox~rni~onandRegress~onEstlrnatlonSVMethodfarSolvingLinearOpemtorEquahoneTheSVMethodIRegulmationbyChoosmgParmeiersofe,InsenslhvityIISVMethodofDens!$EstimationISpllneApproxlrnailonofaDenrltyllApproxlmatlonofaDenrltyw~thGauenanMlxiureIIEsimahonofCond~honalProbab~l~tyandCond~i~onalDene~tyFuncha~sIIIIIEstimahonofCondlhmalhobabllltyFund~msIIIIEstimahonofCond~hmalDens,Fund~onsIConned~onsBetweentheSVMethodandSpaneFunchonApprax~rmt~onllReproducingKemelsH~lbettSpacesModlFledSpaneApproxlrnatlonand~tsRelatlontoSVMachmesSVMachinesforPattanRecopt~onTheQuadraticOpt~rnlzat~onPmblemIIterat~vehocedwefarSpec~fy~ngSuppdVedorsMethodsForSolvlngtheReducedOptm~zat~mhblemDlg~tRecagnlt~onhoblemTheUSPostalSenrlceDatabasePerlmancefortheUSPostalSavlceDatabaseSomeImporiantDetallsComparisonofPafmnceoftheSVMachlnewithGaussianKemeltotheGausslanRBFNetworkTheBestResultsForUSPostalSmrlceDatabaseTangentDistanceDlg~tRecagnlt~onhoblemTheNISTDatabasePerlmanceforNISTDatabaseFuttherImprovementTheBestResultsforNISTDatabaseFubmRaclngOneMoreOppn~$TheTrmsduct~veInfacnceSVMachlnesforFunctlmApproxunahons,RegesslonEstlmatlon,andSlgnalProcessingTheModelSelectionhoblemIFundlmalforModelSelectlonBasedontheVCBoundClarr~calFunchmaleExpamentalCampar~ronofModelSelechmMethodsTheProblemofFeatureSeledlonHasNoGenaalSalubonStrudureontheSetofRegulaniedLinearFund~onsTheLCweMethodTheMethodofEffectweNumberofParmetasTheMethodofEffectiveVCDlmenrlonExpamenisonMeaiunngtheEffedlveVCDlmenr~mFundlmApproxlmailonUalngtheSVMethodWhyDoestheValueofeContmltheNumbaofSupportVectorsSVMachineforRegress~onEshmatlonRoblernofDataSmaothlngEst~mat~onofLmearRegress~onF~rnchonsEshmatlonofNonlmearRegreeelonFund~onsSVMethodforSolvmgthePositronEmlsslmTomogaphy(PET)ProblemDescrlpbonofPETProblemofSolvlngtheRadonEquatlonGenaallrat~onoftheResidualFnncpleofSolvmgPETRoblmsTheClass~calMethodsofSalvlngthePEThblmTheSVMethodforSolvmgthePETRoblmRmakAbouttheSVMethodIllStatirticalFmdatianofLeamhgTheoryNecessaryandSufficlentCondlhonsforUnlfomConvergenceofFt'equenclestothelrPrnbabll~besUnlfmConvsgtllceofkrequenc~estothe~rPmbabd~hesBaelcLemmaEntropyoftheSetofEventsAsymptot~cRopert~esoftheEntropyNecessaryandSufficlentCmdlhmsofUnlfmConvergencePmofofSufflclencyNecessaryandSufficlentCmdlhmsofUnlfmConvergencePmofofNecesslbyNecessaryandSufflclentCondlbmsContlnuabonofProvlngNecesslkjNecessaryandSufficlentCondlhonsforUnlfomConvergenceofMeanstothe~rExpectatlonseEntmpyIIIRoofoftheEx~stenceoftheLmltRoofoftheConvagenceoftheSequtnceTheQuas~mbeeExtens~onofaSetInAulllalyLmaNecessaryandSufflclentCmdlt~oniforTlnlfomCmuagmceTheRoofofpTecessliyNecessaryandSuff~clentCond~honsforUnlfarmConvagmceThehoofofSufficiencyGaollanesErarnThemmLNecessaryandSuff~c~entCondlhonsforTJn~fomOneSldedConvergtnceofMemstoThe~rExpedat~onsInirodud~onMaxmurnVolumeSechmsTheTheoremontheAverageL

用户评论(0)

0/200

精彩专题

上传我的资料

每篇奖励 +2积分

资料评价:

/49
仅支持在线阅读

意见
反馈

立即扫码关注

爱问共享资料微信公众号

返回
顶部