关闭

关闭

封号提示

内容

首页 Vision-Based Path Generation Method.pdf

Vision-Based Path Generation Method.pdf

Vision-Based Path Generation Me…

上传者: 流浪客老爷 2013-12-25 评分 5 0 172 23 783 暂无简介 简介 举报

简介:本文档为《Vision-Based Path Generation Methodpdf》,可适用于高等教育领域,主题内容包含VisionBasedPathGenerationMethodforaRobotBasedArcWeldingSystemTheodorePPach符等。

VisionBasedPathGenerationMethodforaRobotBasedArcWeldingSystemTheodorePPachidisJohnNLygourasReceived:JuneAccepted:AugustPublishedonline:October#SpringerScienceBusinessMediaBVAbstractInthispaperavisionbasedintegratedmethodintendedforpathgenerationforarobotbasedarcweldingsystem,ispresentedThedescribedsystemiscomposedoftherecentlydevelopedpseudostereovisionsystem(PSVS)oranordinarystereovisionsystemandtherelatedsoftwareAdesiredpathcanbegenerated,usingapartortheentireedgeofanimagecapturedfromasceneoftheroboticenvironment,alinemanuallydesignedintheimage,acombinationoflinesofthepreviouscasesorlinesbelonginginsuccessiveimagescapturedfromdifferentscenesAusercaninitiallyprocessimagesselectingbymeansofpulldownmenusavarietyoffilters,edgedetectionmethodsandoperationsThenthedesiredpathasacombinationoflinesisselectedfromimagesApplyingourcorrespondencealgorithm,correspondingedgescanbefoundFinally,anumberofsuccessivepathpointsarecalculatedbymeansoftheproposedpathpointcalculationalgorithmInonlineoperation,thevisionsystemmountedontheendeffectorcancaptureimageswiththedesiredbestview(weldingview)ofascenebymovingorrotating(usingpushbuttons)theendeffectoroftheroboticmanipulator–PUMAOtherfacilitiesofthedescribedsystemaretheselectionofavarietyofcolorsandshapes,histogramview,desiredmagnification,systeminformationandautomaticexecutionofuserselectedoperationsThegraphicaluserinterfaceisdevelopedinVisualC,itrunsinapersonalcomputerandcommunicateswiththeroboticmanipulator(PUMA)throughALTERcommunicationportKeywordsarcweldinggraphicaluserinterfaceimageprocessingpathgenerationpseudostereovisionroboticmanipulatorJIntellRobotSyst():–DOIsyTPPachidis(*):JNLygourasDepartmentofElectricalandComputerEngineering,DemocritusUniversityofThrace,VasSofias,Xanthi,Greeceemail:patedotenetgrJNLygourasemail:ilygoureeduthgrIntroductionAroboticmanipulatorcouldbeusedinanarcweldingsystemInasystemlikethismanyproblemsmaybeencounteredSomeofthemare()theaccuracyofmovementofatorchmountedontheendeffectoroftheroboticmanipulator,()thegenerationofaproperpaththetorchmustfollow,()theflexibilityofthesystemtoadaptthespecifiedpathtoanychangesinshapeofmetalpiecestobewelded,()thepossibilityofthesystemtochangethemovementrate,orthepatternofmovementrelativelytometaltypesorweldingsurfacesshapeTheaboveproblemscouldbetterbemanipulatedwiththeaidofastereovisionsystemandatorchtogethermountedontheendeffectoroftheroboticmanipulatorAstereovisionsystemcouldmeasurewithbetteraccuracythedesiredpathpointsandadaptaninitiallyspecifiedpathtoanychangesofthemetalpiecestobeweldedInsuchasystemtheinitialpathgenerationmaybequiteeasyandfast,withgoodaccuracyThepreviousfeatureswillpermitarcweldingofdifferentinshapeorinmaterialmetalpiecesandtorepeattheprocedurewhenitisnecessarySomeresearchersinrelevantpapersproposemethodsfortheinitialpathgenerationIn–,AlesUdeandRudigerDillmanemployedthe“teachingbyshowing”programmingparadigmAuserspecifiesthedesiredtrajectorybymovingtheobjecttobemanipulatedwithhishandTheperformanceismeasuredwithastereovisionsystemIn,BBrunneretalproposedthesocalledTeleSensorProgrammingconceptasaneasywaytoprogramarobotofflinevialearningbyshowinginavirtualenvironmentRMVoylesandPKKhoslainproposedagesturebasedprogrammingmethodofarobotIn,JohnsonandMarshpresentedthebasicmathematicalandcomputationalframeworkforanewmethodofmodelingrobotmanipulatorworkspacesInhisthesis,Sabesstudiedtheplanningofvisuallyguidedarmmovementsintwocases:feedbackperturbationandobstacleavoidanceIn,LiFangGustudiedthevisualguidanceofarobotbymeansofastereovisionsystemandusingasfeaturescornerpointsPaschkeandPauliinimplementedtheprogrammingbydemonstrationmethodtoreconstructasmoothDtrajectoryofagripper,usingastereovisionsystemIn,RufandHoraudproposedamethodologicalframeworkfortrajectorygenerationinprojectivespaceIntheirpaper,ZhaandDupresentedanewapproachforthegenerationandoptimizationofrobotictrajectoriesinCartesiantaskspaceSimulationismadeinavirtualCADbasedofflineprogrammingenvironmentInthispaper,anintegratedsystemfortheinitialpathgenerationofaroboticmanipulatorisproposedUsingthissystemaninitialpathcouldbecalculatedquiteeasyandfastandwithgoodaccuracyTheinputofthesystemisapairofstereoimagescapturedbymeansofastereovisionsystemoracompleximagecapturedbymeansofourpseudostereovisionsystem(PSVS),Adesiredpathisgeneratedbymeansofthecurrentsceneasastraightorcurvededge,combinationofedgesormoreoveruserdesignedlinesconnectingforexamplethetorchwithanobjectofthesceneForbetteraccuracyincalculations,theselectionofthebestviewofthedesiredsceneispossiblebytranslatingandrotatingtheendeffectorusingpushbuttonsanduserselectedrobotvelocitiesThegraphicaluserinterface(GUI)canbeusedinanyotherapplicationwheregenerallyimageprocessingorparticularlytheextractionofadesiredpathisrequiredThispaperisorganizedasfollowsInSection,thebasicconceptsusedinthesoftwareapplication,aswellastheoreticalnotesofthem,arebrieflyexplainedInSection,abriefdescriptionoftheGUI,whichispartofHumanPTroboticapplication,ispresentedInSection,experimentalresultsareprovidedInSection,ashortdiscussionisgivenFinallytheconclusionsofthisworkarepresentedinSectionJIntellRobotSyst():–BasicConceptsPseudoStereoVisionSystem(PSVS)IntheGUIofthepresentedsystem,asacapturingsystemcanbeusedanordinarystereovisionsystemwithtwocameras,orourpseudostereovisionsystem(PSVS)DetailsforPSVSarepresentedin,Itisamonocularstereovisionsystemcomposedofacameraandfourmirrors(Figure)ThefirstmirrorisathinbeamsplitterTheothermirrorsarefirstsurfacemirrorsUsingPSVSacheapersystemiscreatedcombiningmanygoodfeaturesTheseare:()creationoftwovirtualcameraswiththesamegeometricproperties,fieldofviewandactivefocallength()Theangularfieldofview(FOV)oftheapparatusisthesamewiththeangularFOVoftherealcamera()Ithasslightlybetteraccuracythananordinarystereovisionsystem()ItcapturesacompleximageinasingleslotThiscompleximageiscomposedoftheleftandrightimagesofanordinaryvisionsystemandconsequentlythiscompleximagecanbefasterprocessedThecameracoordinatesystemhasasorigintheopticalcenterOoftherealcameraanditsZCaxiscoincideswiththeopticalaxisfromOTocalculatepathpointcoordinateswithrespecttothecameracoordinatesystem,theintrinsicparametersaswellasthedistortioncoefficientsofthecameramustbefoundHere,thecamerahasbeencalibratedbymeansofZZhangcalibrationmethodwhileforcornerdetectionthealgorithmproposedinhasbeenpreferredThetransformationmatrixwiththeintrinsiccameraparametersis:AaucuavvðÞWhereuo,vo,aretheestimatedcoordinatesoftheimagecenterinpixels,au,avaretheestimatedscalefactorsinimageuandvaxes,inpixelsagainandcistheparameterdescribingtheskewofthetwoimageaxesTheequationsgivingthecoordinatesofapointP(xp,yp,zp)inspace,ingeneralform,forparallelcameras,are:xPuRuRðÞauRzPzRðÞþxRorxPuLuLðÞauLzPzLðÞþxLðÞyPvRvRðÞavRzPzRðÞþyRoryPvLvLðÞavLzPzLðÞþyLðÞzPauLuRuRðÞzRauRuLuLðÞzLþauLxLxRðÞauLuRuRðÞauRuLuLðÞðÞTheaboveequationsbymeansofthesimplificationsbelowareappliedtoPSVS:auLauRauavLavRavxLbmyLzLbþlxRbyRzRbðÞJIntellRobotSyst():–Themodifiedequationsarethefollowing:xPauzPþbuRuRðÞþborxPlauzPþbluLuLðÞbmðÞyPavzPþbvRvRðÞoryPlavzPþblvLvLðÞðÞzPaubþmðÞþluLuLðÞuLuLðÞuRuRðÞbðÞFigure(a)PSVS,mirrorsandvirtualcameras(b)MirrorarrangementinPSVSandrefractionphenomenaduetomirrorJIntellRobotSyst():–InEq–,auistheestimatedscalefactorofvirtualcameras,bisthebaselinelengthanduL,vL,uR,vR,arecoordinatesofapointintheimageplaneTheconstantmistheparalleldisplacementofthevirtualopticalaxisfromOandlisthedisplacementoftheopticalcenterO(Figureb)duetorefractionphenomenainmirror()Theconstantmisequalto:mdcoswþqrðÞcosqrðÞTheconstantlisequalto:ldcosqrsinwþqrðÞþcoswþqrðÞtanwðÞðÞFormirror()thicknessequaltomm(asintheprototypemodelofPSVS),m=mmandl=mm(refractionindices,nglass=andnair=)bisthelengthofbaselinebetweenthetwovirtualcamerasFigurebcontinuedJIntellRobotSyst():–JIntellRobotSyst():–CorrespondenceAlgorithmTheproposedcorrespondencealgorithmbelongsinhighlevelfeaturebasedalgorithmsandparticularlyinalgorithmsthatcanfindcorrespondencesincurvesThealgorithmusedisdescribedinItisbasedontheconceptofseedsToimplementtheproposedcorrespondencealgorithm,acompleximageorastereopairofimagesareinitiallyprocessedIntheapplicationdevelopedinVisualC,avarietyoffiltersandedgedetectionmethodsmaybeusedInthefinaledgeimages,thedesirededgesareselectedasleftviewedges,inasemiautomaticprocedureie,bycoloringapixelmanuallyandthenbypropagatingthepixeltothewholeedgeWhenallthedesirededgesarecolored,withdifferentcolorvalues,thecorrespondingedgesaredetectedInanautomaticprocedure,eachleftviewedgeisautomaticallyselectedfirst,thecorrespondingedgeisdetectedandthewholeprocedureisrepeateduntilallthepairsofcorrespondingedgesaredetectedThreecriteriaareusedtoselectthecorrespondingedge:ThehorizontalupperandlowerlimitsoftheinitialedgeplusasmallpermissibledeviationmeasuredinpixelsThenumberofpixelsineachinitialedgeextendedbyapredefinedpercentageoftheinitialnumberofpixelsThecriterionofthemostprobableedgeUsingthisalgorithmtheselectionandprocessingofindependentedgesorlineswithdifferentcolors,ofanimageofthesamescene,ispossibleTheresults,namely,thecolorofpoints,theirimageplanecoordinatesandthedisparitiesarestoredinamatrixandatthesametimeinafileforfutureuseBelowthecorrespondencealgorithmispresentedintheformofaparadigmTworealweldingworkpiecesandaproperlyformedjointbetweenthemareused(Figurea)Theseworkpiecesarecarefullypreparedsothattoobtainatypicaljointshapewiththeproperangle,rootgapandrootfaceAccordingtotheproposedcorrespondencealgorithmacompleximageorastereopairofimagesareinitiallyacquiredInourparadigmacompleximageiscapturedForcompatibilitywithotherstereosystemsthisimageisdoubledandthentheresultingimagesareproperlysimultaneouslyprocessedprovidingfinallytwoedgeimageswherethedifferentviewsoftheweldingpiecesandthejointbetweenthemareappeared(Figureb)Fromtheleftview(firstimage)theoperatorselectsthedesirededgeoredgesLetconsiderherethatthedesirededgeisonlytheedgeconcerningjointlineSelectionismadebyplantingintheedgemanuallyaproperlycoloredpixelandthepropagationofthispixelalongtheedgeoftheleftvieworbymeansoftheareacoloringtool(itdependsonthedensityofedgesintheareasurroundingthedesirededge)TheresultisacolorededgeAfterthispreparationthethreecriteriaofcorrespondencealgorithmareimplementedAccordingtothefirstcriterion(searchinginthesecondimage)differentinupperandlowerlimitedgesareexcludedAccordingtothesecondcriterionedgeswithadifferentnumberofpixelsarealsoexcludedInthesetwopreviouscriteriaexclusionispossiblebycoloringtheundesirableedgeswithaneutralcolorThenthethirdcriterionisimplementedAbasicconceptofthethirdcriterionistofindonlyasmallnumberofpixels(calledseeds)oftheFigure(a)Compleximageoftwoweldingworkpiecesandofthejointbetweenthem(b)AfterimageprocessingtheresultingedgeimageisillustratedInthisimagethedesiredandthecorrespondingedge,whichisdetectedaftertheimplementationofthethreecriteriaofcorrespondencealgorithmarealsopresentedasleftandrightviews,respectivelyRJIntellRobotSyst():–correspondingedge(subsampling)andthentopropagatetheseseedsalongthewholeedgeThepropagationisapassiveprocedurewithsmallercomputationalcostThusitisfasterandusingpredefinedconditions(ie,processingofasmallnumberoflinesineachimage)couldbeusedinrealtimeapplicationsTheconstraintusedforthecorrespondenceeitherwithanordinarystereosystemorwithPSVSisonlyscanninginascanlineeachtimeCandidateedgepixelsaredetectedandstoredinamatrixwithcountersaccordingtotheirdistancefromtheinitialedgepixelWhenthescanningoftheimageisfinished,distancecorrespondingtothemaximumpopulationofpixelsisconsideredasthemostprobableforthecandidateedgeandatthisdistanceatleastonepixelofthecandidateedgeisdetectedbelonginginthecorrespondingedgeEachoneofthesepixelsisaseedTheseseedshavethesamecolorwiththecolorofthedesirededgeTheyarepropagatedalongthecorrespondingedgecoloringthiswaythewholeedgewiththesamecolorConsequentlytheresultisthecorrespondingedgefoundinthesecondimage(rightview)Thealgorithmwiththeaboveprocedurecouldfindlessseedsthanthepredefinedseednumber(thismaximumnumberispreselectedbytheuser)butduringpropagationalledgepixelsaredetectedScanningthenimages,correspondingalgorithmfindspairsofcorrespondingpixels,storestheircolor,coordinatesanddisparityinamatrixandatthesametimeinafileforofflineprocessingPathPointCalculationAlgorithmBymeansofpixelpairsfoundfromthecorrespondencealgorithm,DpointcoordinateswiththeaidofthestereovisionequationswithrespecttothecameracoordinatesystemcanbecalculatedHoweverthesepointshaven’tthedesiredorder,thuscannotbeusedasroboticpathpointsForthisreasonforeachpairofedgesorlinesthesepointshavetobeclassifiedsothatfromeachpairofedgesorlines,aroboticpathtobegeneratedThispathhasastartandanendpointPointdensity(relatedwithmovementvelocityandacceleration)ineachpathhastobedeterminedandforeachpointanorthonormalcoordinatesystemwithoriginthispointhastobealsoestablishedThus,informationnecessaryforproperlydrivingtheendeffectorofaroboticmanipulatorisensuredBymeansofpathpointcalculationalgorithm,thegenerationofaroboticpathforadesiredtaskispossibleTheendeffectororientationwillchangeaccordingtothesepoint’sdataInthiswaytheendeffectorcanfollowaroboticpaththatitisnotnecessarilyastraightlineConsequentlyarcweldingoncurvedsurfacesispossibleTheproposedalgorithmhasasresulttogeneratefromlinesegmentsdesiredroboticpathsandcombiningthemproperlytogeneratethepathforaspecifictaskCalculationofcoordinatesofpathpointsinvolvestwostages:()rearrangementofdesiredpixelssothattobesuccessivepathpoints,and()necessarycalculationsforeachpairofcorrespondingpixelsprovidingtheDpointcoordinatesThealgorithmisdescribedintheflowchartofFigureAlgorithmDescriptionTheobjectiveoftheproposedalgorithm,asithasbeenreferred,istorearrangepixelsfoundthroughcorrespondencealgorithm,toselectthespecifiednumberofpixelsandtocalculatethefinalpathpointsIndeterminingapath,itisdesirable,tohaveastartandanendpointThus,firstthealgorithmfindsendpointsofeachcolorededgeaswellascrosspointsThealgorithmcanJIntellRobotSyst():–findpointsofinterestinalmosteverytypeofedges(ie,aline,aclosedline,alinewithcrosspoints,combinationofpreviouscases)Thentherearrangementofpixelsbetweentwoendpointsofalineeachtime(endorcrosspoints)followsTherearrangementismadeforallpathpixelsThenextstepistheselectionofthenumberNTofthedesiredpointsineachdesiredpath(thatistoselectthepointsdensity)ThisnumberisuserselectedanddeterminesanequidistantdistributionofpathpointsTheselectedpixelshaveequaldistancesThenforeachpairofpixels,thecalculationofthecoordinatesoftherealpathpointismadeCalculationsarepresentedinthenextsubsectionThedesiredpathpointsaredesignedtemporaryonthescreenassmallcircleswithcenterthespecifiedpointResultsareappearedinthelistboxoftheGUIandaresavedautomaticallyinafileasasetofsixvaluesperline:x,y,z,yaw,pitch,roll(yaw,pitch,rollaretheEulerangles)TheoreticalAnalysisAsithasbeenpreviouslymentionedtheendeffectororientationisnotnecessarilyfixedInordertocalculatethevectorX(x,y,z,y,θ,φ)withrespecttotheworldcoordinatesystemoftheroboticmanipulator,Dcoordinatesofapointwithrespecttothecameracoordinatesystem,aswellas,therotationmatrixofacoordinatesystemattachedwithoriginthispointmightbefoundWeintroduceamethod,betteradaptedtotherequirementsoftheproposedmethodforarobotbasedarcweldingsystemThemethodissupportedbyPSVSbutcanalsobeusedwithanordinarystereovisionsystemwithparallelcamerasAssumingthatthedesirededgeisalinesegmentdefinedbytwopoints,P(x,y,z)asthestartpointandP(x,y,z)astheendpoint,thethreeanglesroll(φc),pitch(θc),yaw(yc)withrespecttocameracoordinatesystemmightbecalculatedTheobjectiveistofindFigureBlockdiagramofthepathpointcalculationalgorithmJIntellRobotSyst():–rotationanglesaroundXc,Yc,ZcaxesofthecameracoordinatesystemsothatYcaxistobeparalleltothelinesegmentBydefinition,insequence,angleyawrepresentsrotationaroundXcaxis,anglepitchrotationaroundYcaxisoftheoncerotatedsystemandfinally,anglerollrotationaroundZcaxisofthetwicerotatedsystemThentheresultingrotationmatrixwillbeR(yc,θc,φc)=R(φc)IR(θc)IR(yc

类似资料

编辑推荐

永乐北藏153.pdf

苏霍姆林斯基选集 五卷本 第四卷.pdf

中国近代建筑史.ppt

苏霍姆林斯基选集 五卷本 第三卷.pdf

The Signal and the Noise ,Nate Silver.pdf

职业精品

精彩专题

上传我的资料

精选资料

热门资料排行换一换

  • 康有为之死.doc

  • 千古风流人物——范仲淹.doc

  • 注塑之背压.doc

  • 英语修辞学教案.doc

  • Skyview Sports M…

  • “我的未来不是梦”主题班会初三1…

  • 妙笔生花的公文写作之道之六十一领…

  • 地基转让协议样本-转让合同[Wo…

  • 个人租房合同.doc

  • 资料评价:

    / 25
    所需积分:5 立即下载

    意见
    反馈

    返回
    顶部